Comment Comment by ripvanwinkle Thank you! Is there a sweet spot with quantization. how much can you quantize for given model type and size and still be useful. parent ripvanwinkle 3 years ago