This is great, but as others have mentioned the UX problem is more complicated than this:
- for other models there are providers that serve the same model with different prices
- each provider optimizes for different parameters: speed, cost, etc.
- the same model can still be different quantizations
- some providers offer batch pricing (e.g., Grok API does not)
And there are plenty of other parameters to filter over- thinking vs. non-thinking, multi-modal or not, etc. not to even mention benchmarks ranking.
https://artificialanalysis.ai gives a blended cost number which helps with sorting a bit, but a blended cost model for input/output costs are going to change depending on what you're doing.
I'm still holding my breath for a site that has a really nice comparison UI.
Someone please build it!
- for other models there are providers that serve the same model with different prices
- each provider optimizes for different parameters: speed, cost, etc.
- the same model can still be different quantizations
- some providers offer batch pricing (e.g., Grok API does not)
And there are plenty of other parameters to filter over- thinking vs. non-thinking, multi-modal or not, etc. not to even mention benchmarks ranking.
https://artificialanalysis.ai gives a blended cost number which helps with sorting a bit, but a blended cost model for input/output costs are going to change depending on what you're doing.
I'm still holding my breath for a site that has a really nice comparison UI.
Someone please build it!