Comment by minimaxir

...how? I'd understand a 20-30% price drop from infra improvements for a model as-is, but 80%?

I wonder if "we quantized it lol" would classify as false advertising for modern LLMs.