Comment

Comment by dgellow

AI inference and training GPUs require way, way more power than anything manufactured before. Like, between 2020 and 2026 we went from ~400W for an A100 to ~1400W for an NVIDIA B300. And you cannot make that happen without changing the datacenter itself. More noise, way more complicated cooling setup, new power sources, etc. Not all datacenters are created equal.

The financing for datacenters is also very shady and its own can of worms

parent dgellow 2 months ago

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton