Comment by verdverm

This is the best side-by-side comparison I've seen so far, we're still waiting for it to become available for download, then we should get much better analyses.

https://news.ycombinator.com/item?id=48999291

I do agree that the benchmarks do not tell much of the story, but this applies to the closed models as well ime.