capitalsigma
Joined 11 years ago
Karma
642
Submissions
289
Member since
Jan 30
Joined 11 years ago
LLMs are a real, genuinely-useful technological innovation that happens to have arrived first in software engineering. Lots of SWEs spend their whole day talking with LLMs and feel a personal connection/expertise with the thing that's also at the top of the hype cycle for non-technical news
Who could have seen this coming???
GPUs "generate tokens" in the same sense that human feet "generate steps"
You can't compare token counts across different providers to get an absolute measure of "total work done" for the same reason that you can't compare step counts across different people to get an absolute measure of "total distance traveled"