Comment Comment by neonbjb You're missing the fact that requests are batched. It's 70 tokens per second for you, but also for 10s-100s of other paying customers at the same time. parent neonbjb 2 years ago