Comment

Comment by hedora

Does this compose well with quantization?

Concretely, if you start with, say, a 1.5 or 4 bit quant, then run this, you get something the size of a 0.5 - 1.5 bits without further degradation in model behavior?

parent hedora 12 days ago

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton