Comment

Comment by airstrike

> Meta released Llama-3 only three days ago, and it already feels like the inflection point when open source models finally closed the gap with proprietary models. The benchmarks show that Llama-3 70B matches GPT-4 and Claude Opus in most tasks, and the even more powerful Llama-3 400B+ model is still training.

I'm all for open models, but where do the benchmarks show that?

The official page https://llama.meta.com/llama3/ does not show any comparisons with GPT-4 or Claude Opus

Looking at https://arena.lmsys.org/, Llama-3-70b-Instruct is ranked #5 while current GPT-4 models and Claude Opus are still tied at #1. Meanwhile, Llama-3-8b-Instruct is ranked #14

Would love to be corrected, but either way an article should include sources for these types of claims.

parent airstrike 2 years ago

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton