k9294
Joined 1 year ago
Joined 1 year ago
But again, it's very far from being a simple serverless micro server that scales infinitely and is super easy to use.
I think AI is even worse than drugs. On the one hand, it has some elements of a slot machine (when you have irregular success with the process, it creates a more powerful cycle of dopamine release on success). On the other hand, it makes work easier, and humans are just wired to choose the easier road. It's like walking or driving a car when you have to travel 10 miles each day. I don't see how, on a civilization scale, AI won't transform our civilization for better or worse.
And if this already happened at least once, how many times it has already happened and was “accidentally” added to the main model?
Here's the same token usage priced at different rates: a real long-running coding task, medium codebase, 447 turns.
Input 1,026,957
Output 164,667
Cache read 36,554,368
GPT-6-astra Type Rate Cost Share
Input 10.000 10.270 19%
Output 50.000 8.233 15%
Cache 1.000 36.554 66%
Total 55.057 100%
DeepSeek v4.1 Flash, $0.003 cache hit Type Rate Cost Share
Input 0.300 0.308 50%
Output 1.200 0.198 32%
Cache 0.003 0.110 18%
Total 0.615 100%
DeepSeek v4.1 Flash, $0.006 cache hit Type Rate Cost Share
Input 0.300 0.308 42%
Output 1.200 0.198 27%
Cache 0.006 0.219 30%
Total 0.725 100%
Hypothetical: same DeepSeek input/output rates, but cache priced so it accounts for 66% of the bill. Type Rate Cost Share
Input 0.300 0.308 21%
Output 1.200 0.198 13%
Cache 0.027 0.982 66%
Total 1.487 100%
This cache it improvement makes the model x2-x2.5 more efficient on a long horizon tasks in terms of cost.I just ran two light tasks on my codebase and got 100% of the weekly limits of a Pro plan blown away. Is Ultra plan any different? Because on Codex it wouldn't affect my Max plan at all, I think it would have been below 1% othese usage.