I'm not a fan of Google just announcing benchmarks for models which won't get into public hands for eternity. It's kinda useless.
If all you want to prove is your internal models deserve a seat at the big boy table, maybe OpenAI and Anthropic should also release benchmarks for GPT 11 and Opus 9, launching in 2030.
If all you want to prove is your internal models deserve a seat at the big boy table, maybe OpenAI and Anthropic should also release benchmarks for GPT 11 and Opus 9, launching in 2030.