Comment Comment by _davide_ > <200ms for 45 questions at onceConsidering your own question length: ~120 characters x 45 divided by 4.1 ~= 1317 tokens.So question processing at 5.5k PP(around the actual PP speed of GPT5.6 Sol) it would take around ~0.24 seconds + the context processing.Computing the output should be around ~20ms (at 50 tok/s), computing 45 tokens in parallel.> have 0% malformed outputPretty trivial; only the allowed output is selectable :)So, I keep repeating myself: Jev was a low-hanging fruit all along; no one cared, and probably no one will in a few weeks? parent _davide_ 1 month ago
Considering your own question length: ~120 characters x 45 divided by 4.1 ~= 1317 tokens.
So question processing at 5.5k PP(around the actual PP speed of GPT5.6 Sol) it would take around ~0.24 seconds + the context processing.
Computing the output should be around ~20ms (at 50 tok/s), computing 45 tokens in parallel.
> have 0% malformed output
Pretty trivial; only the allowed output is selectable :)
So, I keep repeating myself: Jev was a low-hanging fruit all along; no one cared, and probably no one will in a few weeks?