Comment

Comment by gregojaca

What's the prefill speed and time to first token? Did you see any slowdown at concurrency for the prefill or decode?
parent gregojaca 23 days ago

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton