Comment

Comment by pixl97

Any model ran takes compute. Everybody, datacenters and local need compute.

And I don't see a future where datacenters lose much to open models. I've ran local server rooms before clouds were a thing. Cooling and power is a very expensive pain in the ass. You're not dropping a rack of local models in most buildings without breaking the local power grid.

parent pixl97 1 month ago

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton