Comment

Comment by skohan

Memory size is a bottleneck, but I have found that speed is very important for getting actual work done. Running a big model is great, but if you're getting 10t/s you're going to be spending a lot of time waiting.
parent skohan 3 days ago

No comments yet

Be the first to share your thoughts.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton