Comment

Comment by eigenspace

So in your imagined scenario here, are you saying that the models are purposefully bloated, using way more VRAM than they actually need?

Like do you think the only reason the models are big is so that they can't be run on consumer hardware, and there's no other benefit?

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton