Iron and fiber are durable and last for decades. Data centers (where the current flows for inference) consist of hardware that becomes obsolete within 5 to 10 years.
The question is can improvements in the hardware both in cost and performance outpace the increased demands on the LLMs and their future derivatives.
The question is can improvements in the hardware both in cost and performance outpace the increased demands on the LLMs and their future derivatives.