Comment Comment by vanviegen That seems unlikely. There are many providers for open models on openrouter. It seems unlikely that they are throwing money away for each token they sell.Also, there a good technical reasons for inference being much more efficient at scale. parent vanviegen 5 months ago
Also, there a good technical reasons for inference being much more efficient at scale.