Comment

Comment by pandastronaut

Even starting at 30%, the MMLU graph is false. The four bars are wrong. Even their own 73,7% is not at the right height. The Mixtral 71.4% is below the 70% mark of the axis. This is really the kind of marketing trick that makes me avoid a provider / publisher. I can't build trust this way.

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton