Thanks for sharing. Counterpoint: H100's MSRP for around $30k. For 6 months at $12/hr, that's $51,840 revenue per card. So they're hitting break even in 3 months, everything after that is profit (minus electricity, etc), and the cards are still selling for around MSRP used.
The real question IMO is building capex. Those depreciate over a longer timeline, but if demand were to drop in 5 years and we have an excess of datacenter space, that's going to hurt. We're approaching the physical limits of what's possible with silicon and fiber optics. Unless there are new architectures or break throughs in algorithms, the only way to make AI more productive today is to build larger clusters, or much longer training/RL runs.
The real question IMO is building capex. Those depreciate over a longer timeline, but if demand were to drop in 5 years and we have an excess of datacenter space, that's going to hurt. We're approaching the physical limits of what's possible with silicon and fiber optics. Unless there are new architectures or break throughs in algorithms, the only way to make AI more productive today is to build larger clusters, or much longer training/RL runs.