Comment

Comment by sourcecodeplz

For coding you want more precision so the higher the quant the better. But there is discussion if a smaller model in higher quant is better than a larger one in lower quant. Need to test for yourself with your use cases I'm afraid.

e: They did announce smaller variants will be released.

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton