Unverified60% confidenceSolutionExact time
Low-rank decomposition and quantization compression are orthogonally complementary dimensions; quantizing the smaller matrices A and B separately results in smaller errors, and the combined compression ratio can reach several times that of either method alone
2
Sources
60%
Confidence
Long-term
Relevance
7/19/2026
First Seen
Sources
Related Claims
UnverifiedThe idea behind latent factor decomposition is to assume that weight matrices have redundancy and low-rank structure, and to reconstruct the original weights using a set of smaller latent factors along with indices or combination methods.74% similarVerifiedLoRA decomposes the weight update matrix ΔW into the product of two small matrices A and B whose ranks are much lower than the original matrix, reducing parameter count to as little as one ten-thousandth of the original or even less.73% similarUnverified分组量化将权重矩阵按固定大小（通常32或64个元素）分组，每组独立计算量化缩放因子以减少精度损失73% similarUnverifiedThe optimization objective is to simultaneously minimize the model's loss under soft-pruned states across multiple sparsity targets, enabling the model to learn at once to degrade smoothly under multiple compression ratios.72% similarUnverifiedllama.cpp的K-quants系列采用超块分组量化策略，相比早期均匀量化在同等压缩率下可降低约20-30%的困惑度损失72% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/560267API
curl https://kongchang.com/api/v1/knowledge/claims/560267MCP
get_claim(id=560267)