I think the whole "runtime for AI agents" will split into multiple categories - each chosen by the agent at run time, ideally from a single provider. I'm working on an agent harness currently and realized: The agent doesn't need a full blown Linux environment all the time - often times all it needs is maybe some custom tool/script written in python/js. Having said that, providing a VM like QuickJS for running simple code could be enough (thus also cheaper). True the real savings will show up at scale BUT, I feel in couple of months, we'll start to feel scarcity of CPU and RAM in datacenters, just like we feel it with GPUs.
Imagine, in 5 years from now, pretty much everyone will be using agents, agents will generate most of the internet traffic at 10 fold scale we use the internet right now. That workflow needs CPU and RAM, not GPUs.
Then being able to run small scripts in a VM that doesn't need operating system will not be "nice" it will be essential.
Then being able to run small scripts in a VM that doesn't need operating system will not be "nice" it will be essential.