"Companies"? A huge proportion of Openrouter tokens are coming from Hermes. That is not "companies", that is "AI bros using Hermes to do things that could be done with a dozen lines of python" and inflated by the massive overhead that is the system prompt hermes generates for each request. Even with just a few tools and skill files it can reach 20-30k tokens.
I'm not kidding when I say that if anything comes out which substantially improves Hermes token efficiency,or causes a large number of Hermes installations to fail or stop being used (like a major security vulnerability), Openrouter and some of their providers will be in trouble.
I'm not kidding when I say that if anything comes out which substantially improves Hermes token efficiency,or causes a large number of Hermes installations to fail or stop being used (like a major security vulnerability), Openrouter and some of their providers will be in trouble.