H100 is nearing five years and costs more to buy a used one now than a new one when it was released :)
You are completely missing the bet these companies are making.
They think can outlast their competitors and capture a larger portion of the pie while the cost of inference keeps going down dramatically.
If you haven't been paying attention, the cost is about 1/100th of what it was in 2024. This is the trajectory pretty much every technology has followed.
Of course there will be market crashes and corrections and things like that and most companies won't survive, but the bet is that whoever survives ends up doing pretty well.
You are completely missing the bet these companies are making.
They think can outlast their competitors and capture a larger portion of the pie while the cost of inference keeps going down dramatically.
If you haven't been paying attention, the cost is about 1/100th of what it was in 2024. This is the trajectory pretty much every technology has followed.
Of course there will be market crashes and corrections and things like that and most companies won't survive, but the bet is that whoever survives ends up doing pretty well.