H hanlab.mit.edu SVDQuant: 4-Bit Quantization Powers 12B Flux on a 16GB 4090 GPU with 3x Speedup 179 points lmxyy 2 years ago 65 comments
