Verified75% confidenceFactTime unknown
LoRA reduces the number of trainable parameters by injecting low-rank decomposition matrices into the model's weight matrices, making it possible to fine-tune models with billions of parameters on consumer-grade GPUs.
5
Sources
75%
Confidence
Long-term
Relevance
6/1/2026
First Seen
Sources
Related Entities
Related Claims
VerifiedLoRA achieves fine-tuning by inserting low-rank decomposition matrices alongside the model's weight matrices, typically requiring training of only 0.1%–1% of the original parameter count.80% similarVerifiedLoRA是以参数高效微调（PEFT）为代表的主流微调方法，核心思想是在不改动原始模型权重的前提下向特定层注入低秩矩阵，只训练新增参数79% similarUnverifiedLoRA是主流的参数高效微调算法，其核心假设是大模型参数更新矩阵的本征秩远低于其实际维度78% similarUnverifiedLoRA 由 Hu 等人在 2021 年提出，通过为每层注入可训练的低秩分解矩阵实现参数更新 ΔW = BA，将可训练参数量压缩至原始模型的 0.1%-1%74% similarVerifiedLoRA（低秩适应）的核心思想是模型权重更新矩阵本征秩很低，无需更新全部参数，只需并联两个低秩矩阵74% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/33645API
curl https://kongchang.com/api/v1/knowledge/claims/33645MCP
get_claim(id=33645)