Comment by pheggs

I have a different experience and find them just as good as the latest anthropic and openai models. But then, we probably can just have opinions on this as benchmarks are probably used for marketing to a large degree. I find it hard to find truly independent benchmarks that don't have any ties to the cash flow of openai and anthropic, can not be trained up on etc.