ConceptQAT / Quantization-Aware Training
Quantization-Aware Training
A model quantization training method in which the model simulates quantization operations during the training phase, retaining full-precision weight copies while practicing rounding. This approach allows the model to adapt to extreme compression.
Timeline (last 90 days)
Aug 25
NVIDIA在其NeMo框架中已内建了QAT支持管线
Unverified50%