Verified70% confidenceFactExact time
Q4 means each weight is stored using 4-bit integers, reducing the size by approximately 75% compared to the original 16-bit floating point
4
Sources
70%
Confidence
Long-term
Relevance
10/7/2026
First Seen
Sources
Related Entities
Related Claims
VerifiedQ4_K_M uses mixed precision, storing some critical weights at 6-bit and the remainder at 4-bit, with an overall average of approximately 4.5-bit.79% similarVerifiedQLoRA introduces 4-bit quantization on top of LoRA, further compressing memory requirements to a fraction of the original.79% similarUnverified4-bit quantization means each parameter occupies only 0.5 bytes, reducing VRAM usage by 75% compared to FP16.76% similarUnverifiedQ4_K_M is generally regarded as the best balance between quality and size, retaining approximately 95% of the original model's capability while compressing the size to about one-quarter of FP16.75% similarVerifiedQLoRA quantizes the base model weights in 4-bit NF4 format, making it possible to fine-tune a 13-billion-parameter model on a single GPU.75% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/984400API
curl https://kongchang.com/api/v1/knowledge/claims/984400MCP
get_claim(id=984400)