There is a strange dynamic between data center build out and inference prices.
If the data centers do get built and come on line, we will see an increase in compute supply and that should lower inference prices.
If they don't, for whatever reason including financial ones, then we will not have enough compute to meet demand and inference prices will rise. But this would mean the financial concerns were misplaced.
If the data centers do get built and come on line, we will see an increase in compute supply and that should lower inference prices.
If they don't, for whatever reason including financial ones, then we will not have enough compute to meet demand and inference prices will rise. But this would mean the financial concerns were misplaced.
Where is the equilibrium point?