Comment by re-thc

> Where LLMs excel is in code-level bugs (as opposed to system bugs, design bugs, architecture bugs, integration bugs, etc).

Blame the benchmarks game. They're optimizing for that and that's what those things are measuring.