Comment Comment by Wilya Yeah, that completely invalidates his point.I looked at a couple random agentic sessions in my openrouter activity, and the input cost is 10x the output cost.Prompt caching on openrouter is complicated and unreliable. On local hardware with llama-cpp, it's mostly free. parent Wilya 5 months ago
I looked at a couple random agentic sessions in my openrouter activity, and the input cost is 10x the output cost.
Prompt caching on openrouter is complicated and unreliable. On local hardware with llama-cpp, it's mostly free.