Comment

Comment by thebitstick

Local LLM use isn't really continuous though. You're comparing Apples to oranges.

For training especially and for the datacenter, NVIDIA cards still make absolute sense. But for consumer use cases, and even for developers, it's not so cut and dry. Very comparable performance for short-term bursts of compute.

parent thebitstick 2 years ago

No comments yet

Be the first to share your thoughts.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton