Comment Comment by hedora Does this compose well with quantization?Concretely, if you start with, say, a 1.5 or 4 bit quant, then run this, you get something the size of a 0.5 - 1.5 bits without further degradation in model behavior? parent hedora 12 days ago
Concretely, if you start with, say, a 1.5 or 4 bit quant, then run this, you get something the size of a 0.5 - 1.5 bits without further degradation in model behavior?