ConceptMixed-Precision Quantization
Mixed-Precision Quantization
A quantization approach that assigns different bit widths to different parts of the same model. Its key challenge lies in measuring the importance of each part in order to allocate the bit budget.
Timeline (last 90 days)
Oct 30
dLLM-KVQ uses the trajectories generated by TRACE to select, based on output-level and attention-level behavioral metrics, the K cache entries in each layer that need to be kept at high precision, while applying standard low-bit quantization to the Value cache.
Unverified50%