Comment

Comment by sigmoid10

It has already become irrelevant to anyone paying attention. Raw scores at published benchmarks mean next to nothing in modern use. They are either gamed to hell or unsolved to the point where differences can be explained by randomness. Speed, cost per token, tokens per task and hallucination levels are the useful axes you can compare along these days if you're not doing scientific frontier level research.
parent sigmoid10 2 days ago

No comments yet

Be the first to share your thoughts.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton