Comment Comment by YetAnotherNick For the still training 400B: Llama 3 GPT 4(Published) BBH 85.3 83.1 MMLU 86.1 86.4 DROP 83.5 80.9 GSM8K 94.1 92.0 MATH 57.8 52.9 HumEv 84.1 74.4 Although it should be noted that the API numbers were generally better than published numbers for GPT4.[1]: https://deepmind.google/technologies/gemini/ parent YetAnotherNick 2 years ago
[1]: https://deepmind.google/technologies/gemini/