Alchemy involved a lot of do-it-yourself though. With AI it is like someone else does all the work (well, almost all the work).

It was mainly a jab at the protoscientific nature of it.

Reproducing experimental results across models and vendors is trivial and cheap nowadays.

Not if anthropic goes further in obfuscating the output of claude code.

Why would you test implementation details? Test what's delivered, not how it's delivered. The thinking portion, synthetized or not, is merely implementation.

The resulting artefact, that's what is worth testing.

> Why would you test implementation details

Because this has never been sufficient. From things like various hard to test cases to things like readability and long term maintenance. Reading and understanding the code is more efficient and necessary for any code worth keeping around.