AA has dramatically altered their methodology twice in just a few weeks. I really don’t see the utility in their composite scoring anymore - it’s basically the US News college rankings of LLMs.
For the time being, LiveBench seems to provide a better calibrated signal.
For the time being, LiveBench seems to provide a better calibrated signal.