Comment Comment by f311a Why is it so small, but expensive?Open RouterInput /M $0.45Output /M $3.20Cache read /M $0.05Throughput 27 tpsIt would be a very nice model at 200-300 tps and if it was dirt cheap. What's the limiting factor of optimizing speed and price for inference providers? parent f311a 2 months ago
Open Router
Input /M $0.45
Output /M $3.20
Cache read /M $0.05
Throughput 27 tps
It would be a very nice model at 200-300 tps and if it was dirt cheap. What's the limiting factor of optimizing speed and price for inference providers?