Comment

Comment by colorant

Prompt length mainly impacts prefill latency (FTFF), not the decoding speed (TPOT)
parent colorant 1 year ago

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton