Unverified50% confidenceFactExact time
LoRA的数学原理是将权重更新矩阵分解为两个低秩矩阵的乘积,文件体积通常仅几十至几百MB
1
Sources
50%
Confidence
Long-term
Relevance
7/21/2026
First Seen
Sources
Related Claims
VerifiedLoRA(Low-Rank Adaptation)文件体积通常只有几十MB,远小于完整模型的数GB大小71% similarUnverifiedLoRA(Low-Rank Adaptation)冻结预训练模型全量权重,仅向特定层注入两个低秩矩阵,文件体积通常只有几 MB 到数十 MB71% similarUnverifiedLoRA 由微软提出,其核心思想是将权重更新量 ΔW 分解为两个低秩矩阵的乘积 BA71% similarUnverifiedLoRA设计使训练参数量减少95%以上,文件大小通常仅在数MB到数百MB之间63% similarUnverified用一个4000维的嵌入乘以一个4000×4000的矩阵需要1600万次乘法,模型由40个堆叠层构成,为单个词元设置Attention大约需要20亿次运算62% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/579732API
curl https://kongchang.com/api/v1/knowledge/claims/579732MCP
get_claim(id=579732)