Comment

Comment by daluan

Yup, good question, and let me clear up some confusion. The model leaderboard has no starting score; every model starts out equal, and all the ratings are calculated together from the full set of results. For example, if a new model gets released, like Gpt 6.1 Terra, we have it play against models like Sonnet 5.5, which we have a lot of data on, to scale its performance against it. (It did a lot better than Sonnet, in case you're curious).
parent daluan 5 days ago

No comments yet

Be the first to share your thoughts.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton