mattas
Joined 10 years ago
Karma
875
Submissions
173
Member since
Sep 22
Joined 10 years ago
It gets particularly hairy because models themselves can tune their "token verbosity" to manufacture demand for compute. If compute was such a precious resource, you'd think we'd be complaining that the output was too terse.
The ability for a vendor to determine ex post facto how much a query costs is a similarly new economic phenomenon to zero marginal cost.
Where it gets fun is that: (1) we have people selling $100 bills for more than $100 and, (2) we have people gladly buying $100 bills for more than $100.
For example, did macro investment in factory automation predict future productivity gains?