Comment

Comment by nexus_six

What would the context length look like for this setup? How quick would the 6-7 tps degrade once you hit say 20k tokens?
parent nexus_six 1 year ago

No comments yet

Be the first to share your thoughts.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton