Comment

Comment by verdverm

costs are in a large part tied to model parameter count, eg. a small model fits on one GPU, the biggest models require an entire rack

the primary difference you see through those prices is model size

that you don't seem much capability difference is why Big Ai is pushing for regulatory capture, because small models are nearly as good for many tasks at a fraction of the cost, undermining the business model they have used to justify the most expensive infra build out in human history

parent verdverm 1 month ago

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton