Comment Comment by qudent It does affect the throughput for an individual user because you need all output tokens up to n to generate output token n+1 parent qudent 8 months ago
