tadfisher
Joined 15 years ago
Karma
7,058
Submissions
2,501
Member since
Apr 14
Joined 15 years ago
The usefulness of testing is basically orthogonal to the advent of language models. This question boils down to whether you think the agents are "cheating" through changing the invariants encoded by the tests to something that no longer matches your project's requirements. To this, I would suggest that you read the code they produce, tests included, and not sign off on stupid changes to cheat on tests. This is not a common thing I've caught agents doing, FWIW.
[ my public key: https://keybase.io/tad; my proof: https://keybase.io/tad/sigs/Vw0DO9f6-Mv6xwHyxW6uZyQCUvYKriR4Giad4RleQ6M ]