Comment by snowfield

A developer can blast millions of tokens in minutes. When you have a context size of 250k that’s just 4 queries. But with tool usage and subsequent calls etc it can easily just do many millions in one request

But if you just ask a question or something it’ll take a while to spend a million tokens…