Comment

Comment by bretpiatt

They aren't "fast-depreciating infrastructure" -- research shared by a16z team, rental rates are up across the board, even for GPUs that are 5+ years old. The demand is real right now. The proverbial tide could go out but we aren't seeing it yet.

Source: https://x.com/a16z/status/2113986385908842870

"Zooming out, GPUs are still renting ahead of a standard 6-year depreciation schedule

Rental price vs. schedule: - H200: +143% - B200: +111% - RTX PRO 6000: +73% - H100: +54% - A100: +9%

Most of the gap opened up after April, when token demand took off"

parent bretpiatt 5 days ago

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton