Centralization is vastly more energy efficient than decentralization, by orders of magnitude. LLMS love batching, to an insane degree. Running a single conversation through a GPU is about the same cost as doing ~100 in parallel.
Centralization is a huge huge environmental win, far far more than even cloud computing was compared to tons of inefficient, under utilized racks spread though our office buildings.
Centralization is a huge huge environmental win, far far more than even cloud computing was compared to tons of inefficient, under utilized racks spread though our office buildings.