Yes, but, I can run qwen 3.8 flash next (> 100b parameters; ~ opus 4.6) on a 200W tdp desktop.
So, assume 8 of those, and it’s a space heater per house. I have never been disturbed by my neighbor’s space heater.
The problem is centralization, not the absolute energy usage. (And also that LLMs are trending to 100x more efficient than the data center sizing assumed).
So, assume 8 of those, and it’s a space heater per house. I have never been disturbed by my neighbor’s space heater.
The problem is centralization, not the absolute energy usage. (And also that LLMs are trending to 100x more efficient than the data center sizing assumed).