WarmWash
Joined 9 months ago
Joined 9 months ago
Take out the "human" and it's all just algos on a scale of complexity.
The reason it's so cheap is because they have compute sitting idle. Meanwhile the big players are rate limiting, using quotas, and keep prices high to keep enough compute available to meet demand.
For those who do, the models could be worth upwards of $5,000 month easy.
The insane spending has effectively been acting as a nationwide stimulus for construction, the trades, hardware feeders, electronics companies, energy companies and then the downstream effects of the affluent class ("The 25%") spending more as they see their investments grow.
The economy is a net, not a whack-a-mole.
There is no future timeline where people are giving away compute for free. Right now we are still in the "Get them hooked" phase.
A clamp on down on DC construction would basically slam the current economy into a wall.
Lots of people celebrate that as being some kind of end of AI, but it wouldn't be, it would ultimately just throw gas on the fire of "we need to cut heads, figure out how to get AI to leverage your productivity".
It's a real killer for "calorie blind" people to go on a 750 calorie hike, and then stop by for a "treat" on the way home. That treat being a 500 calorie blueberry muffin with 200 calories of butter on it. Then they go home and have dinner.
SOTA open models need tens of thousands of dollars worth of hardware to run.
I get your analogy, and it feels right, but the compute requirements to run these models are extreme. That analogy falls apart when it necessitates having a corporate 3rd party run the models for you. They will not tolerate breaking laws.
If China says no more, then the best the masses are gonna get on their high-end setups are the 30B class models. Which are decent, but not "hack my bank", errr, "protect our bank" decent.
Piracy flourished because you only need an operating laptop to participate. LLMs you need a server rack of GPUs to participate.
Whether or not people actually follow through is another story. There weren't any cigarette smokers who didn't know how bad it was for them...