Comment Comment by colorant Prompt length mainly impacts prefill latency (FTFF), not the decoding speed (TPOT) parent colorant 1 year ago