Comment by nylonstrung

The vast majority of LLM usage probably would pass evals equally well on a smaller model

I see tons of devs fretting about how only Opus is "smart" enough for the React CRUD web app they are building even though Sonnet and Chinese models are demonstrably equivalent for most real world developer use cases