CoolestBeans
Joined 8 years ago
Joined 8 years ago
The next step is whether data center capex discipline begins filtering to Nvidia and the DRAM semis revenues. At that point pure play companies must drive revenue growth or else.
One issue is that token usage and revenue seem to be decoupling in real time. For Jevons paradox to be true, prices need to be going down but total spend on AI has to be going up. That's technically true right now but total usage is going way up while total spend is going up slightly. Another problem is that we may be witnessing the end of "tokenmaxxing" with Anthropic's revenue growth decelerating and OpenRouter's token volume plateauing. Two points of data do not make evidence but the possibility that AI usage is an S curve rather than exponential is live.
2. Selling tokens via long running agents is the only thing that's provably working with respect to revenue growth.
3. They need revenue yesterday. Increases in borrowing rates means access to capital isn't what it was in the 10s. Their runway is much shorter than you would imagine.
4. Some of the decision makers at these companies believe AI will exhibit Jevons Paradox and that any decrease in price will result in induced demand.
5. The frontier models are still subject to the limitations of AI. They're not good at everything. Better to have someone else learn that on their dime rather than yours.
LLMs are not this, and they cannot be this because it is their ability to operate on vague instructions that make them as powerful as they are. They can take an imprecise natural language description of a process and realize it as a process in a programming language. The problem is that understanding and manipulating the precise problem description is your job as a software engineer. The LLM can and will make its best attempt based on what exists in its training data, but it cannot know what is the precise behavior that actually fulfills goals and I think, contrary to the parent article, it cannot determine where the edges are to ask you with enough certainty that you will be able to take your hands completely off the wheel.
I think the nature of LLMs also explains why it is good at the verticals it is good at. Porting is an extremely well defined, replicate the behavior on another platform. There are far fewer vagueries in that. Game dev is not extremely well defined, but the consequences of imprecision do not have a lot on the line. Furthermore, games are pretty self-contained, so there's not a lot of guessing about what could happen or what the behavior of a counterparty system could be. With some pretty big exceptions, it is all there for the LLM to see in C++ (or whatever).
The other part is how big the debt load is downstream. Anthropic is one of the revenue engines that has to feed the rest of the supply chain, clouds, SPVs, semiconductors, etc. They have to be pulling very large numbers to justify everyone else's finances.
I think the growth is real and tremendous and that's probably more important than this blip in revenue growth. But things tend to look peachy until they're not and so everyone is on watch for cracks in the foundation.
Again, two data points do not make a full story but if you're an AI bull this is not what you want to see.
Programs are swapping capstone projects and courses for comprehensive oral examinations and that's partly from input from industry that there's been a skill drop. But that feels like a panic stopgap and we really are going to struggle with this for a while.
All this being said, I don't think AI usage will meaningfully go down in the long run cause it's a very powerful dopamine loop and tech companies are very good at making those. How many people report social media making them unhappy and how many people do you know who have actually quit? Or to paraphrase Jim Gaffigan, nobody says they eat at McDonalds, but the sign outside says "billions served". Somebody's lying (and it's not McDonalds).