Comment

Comment by criley2

I certainly don't think the self-reported single benchmark scores are the best way to answer the question. I waited for the Artifical Analysis run (which itself is still mediocre, but at least it's an order of magnitude better), and predictably the results tell a different story.

Sol 6.1 High: 50 intelligence, $0.32 per task, 4.4 min per task, 13k output tokens per task

Sol 6.1 Medium: 48 intelligence, $0.21 per task, 2.9 min per task, 8k output tokens per task

Deepseek 4.1 1017: 45 intelligence, $0.26 per task, 4.8 min per task, 89k output tokens per task

If you look at the actual pareto frontier across the full benchmark, Sol 6.1 remains firmly on the pareto line, while deepseek remains firmly under it, just as it was before https://i.imgur.com/N72p5NF.png

This result is exactly as I expected, and seems to run counter to the effusive praise of this thread. Sol 6.1 Medium is producing higher quality output at a lower price with nearly 10X less output tokens! And this is not surprising.

And finally, Mimo V2.6 Pro continues to look like a stunning release, clearly smarter, cheaper and faster than deepseek v4.1 1017

parent criley2 13 days ago

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton