I am not sure for how long the output will stay absolutely free. But apart from the pricing advantage of Jev itself, I just love the simplicity of having only an input price. Input is pretty easy to estimate and calculate upfront, which makes the cost of running something at scale much more predictable.
With LLMs, even with JSON schema constraints and structured output, the actual cost can still be hard to predict because of varying output lengths and, especially, unpredictable reasoning costs. There is something really nice about being able to tokenize and predicting the budget beforehand.
With LLMs, even with JSON schema constraints and structured output, the actual cost can still be hard to predict because of varying output lengths and, especially, unpredictable reasoning costs. There is something really nice about being able to tokenize and predicting the budget beforehand.