Verified65% confidenceFactExact time
LoRA decomposes the fine-tuning weight change ΔW into the product of two low-rank matrices, with a parameter count of only 0.1%–1% of the original model, achieving a parameter compression ratio as high as 256× when r=8 and d=4096.
3
Sources
65%
Confidence
Long-term
Relevance
7/14/2026
First Seen
Sources
零基础学AI大模型：避开三大误区的完整学习路径
Related Claims
VerifiedThe rank r of the low-rank matrices in LoRA is typically set to 8 or 16, reducing the number of trainable parameters from d×k to r×(d+k), a reduction of up to hundreds of times.74% similarUnverifiedLoRA由微软研究院于2021年提出，对权重更新量ΔW进行低秩分解ΔW = A·B，参数量通常可压缩至原来的1/100以下73% similarUnverifiedTaking D=4096 and r=8 as an example, the number of LoRA parameters is only 0.39% of the original, with a 250-fold reduction in computation.71% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/504219API
curl https://kongchang.com/api/v1/knowledge/claims/504219MCP
get_claim(id=504219)