It interests me that the $200-600 billion number seems to be all-derived from GPUs. Are LLMs/AIs totally dependent on GPUs? I read last week (https://news.ycombinator.com/item?id=40787349) that there is research ongoing to run LLMs on FPGAs at greater energy efficiency.
I'm reminded of Bitcoin/crpyto, which in its early history was all operated on GPUs. And, then, almost overnight, the whole thing was run on ASICs.
Is there an intrinsic reason something similar couldn't happen with LLMs? If so, the idea of a bubble seems even more concerning.
I'm reminded of Bitcoin/crpyto, which in its early history was all operated on GPUs. And, then, almost overnight, the whole thing was run on ASICs.
Is there an intrinsic reason something similar couldn't happen with LLMs? If so, the idea of a bubble seems even more concerning.