Comment

Comment by thaanpaa

And yet enterprises will be the first to move to on-prem LLMs as soon as they become feasible. The next generation of TPU chips already promises 5x efficiency and enough RAM to run a 1TB+ model, and Kimi K3 is about as good as Fable for a lot of tasks, so we'll be there much sooner than anyone anticipated.
parent thaanpaa 2 months ago

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton