Comment Comment by latchkey Elio clarified this to me, he said...256 tokens in 1 prompt/batchNot 256 batches parent latchkey 2 years ago
256 tokens in 1 prompt/batch
Not 256 batches