I recognize that, generally, the circles I'm a part of tend to pay the most attention to Coding-focused evals and benchmarks as frontier models improve. Biggest jumps I'm seeing with Astra and 6/6.1 Sol, and their Anthropic counterparts to a smaller degree, seems to be in spatial reasoning and playing games.
Looks like Argon wasn't covered here, but I'm getting the sense that Argon made similar leaps as Astra did. I would certainly be curious how Argon would have done here- it did quite well on RuneBench (https://maxbittker.github.io/runebench/).
Looks like Argon wasn't covered here, but I'm getting the sense that Argon made similar leaps as Astra did. I would certainly be curious how Argon would have done here- it did quite well on RuneBench (https://maxbittker.github.io/runebench/).