Comment Comment by SpicyLemonZest That's just not accurate. I haven't studied SWE Bench Pro in detail, so I can't tell you exactly what the flaw is, but SOTA models routinely make bad architectural choices I have to intervene to fix. parent SpicyLemonZest 6 months ago