If you can't get Opus 5.5 to pass more than 80% of your test suite, then you're probably holding it wrong. Not "holding it wrong" as in Apple's "we designed a defective product and try to put the blame on you", but as in *"this is an incredibly sophisticated tool which takes skill and practice to use to its fullest extent".
LLMs, even in a good harness, are deceptively simple, but in reality rather complex tools. They're good at grasping intent, but they can't read your mind, they might not have access to the full context of your business, and they require learning how to use them properly.
LLMs, even in a good harness, are deceptively simple, but in reality rather complex tools. They're good at grasping intent, but they can't read your mind, they might not have access to the full context of your business, and they require learning how to use them properly.