Comment

Comment by bernaferrari

if you want to be lazy, 7b = 7gb of vRAM, 12b = 12gb of vRAM, but quantizing you might be able to do with with ~6-8. So any 16gb Macbook could run it (but not much else).

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton