Comment by garo-pro

Part of the cheaper costs, if not the majority, probably are KV cache optimisations. https://insufferable.dev/posts/the-ai-race-just-got-awkward/