I definitely feel something is "wrong" with these benchmarks.
I don't have much experience with anything outside of Claude for frontier models (and only haiku/3.x flash/5.6+6 luna at the entry level) so take this with that in mind.
I find Fable is still SIGNIFICANTLY 'smarter' then opus 5.5 when figuring out HOW to do something that's non-mechanical (e.g. How should we handle this aspect of business logic?"). Opus comes up with perfectly usable options, however Fable more often comes up with options that are more aligned with what I expect, or accept.
I don't have much experience with anything outside of Claude for frontier models (and only haiku/3.x flash/5.6+6 luna at the entry level) so take this with that in mind.
I find Fable is still SIGNIFICANTLY 'smarter' then opus 5.5 when figuring out HOW to do something that's non-mechanical (e.g. How should we handle this aspect of business logic?"). Opus comes up with perfectly usable options, however Fable more often comes up with options that are more aligned with what I expect, or accept.