#SVDQuant

SVDQuant: 4-bit Quantization Enables Efficient Diffusion Model Inference on Consumer GPUs

SVDQuant, an ICLR 2025 Spotlight paper, achieves 4-bit diffusion model quantization via low-rank decomposition that absorbs outliers, reducing memory by 75%. Open-source engine Nunchaku (3800+ stars) enables FLUX inference on consumer GPUs like RTX 4060.