Comment

Comment by zaj00l

I wouldn't say worthless but once you get used to 100+ tokens / s, it's really a visible slowdown, especially when running multiple agents acting on something more than basic prompt processing.

Still, as you said - for day to day, 50-60 tokens / s is a good baseline.

parent zaj00l 2 months ago

No comments yet

Be the first to share your thoughts.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton