Unverified50% confidenceFactExact time
LoRA uses a scaling factor alpha/r to scale the update, so adjusting r does not require extensively re-tuning the learning rate, reducing the cost of hyperparameter search.
1
Sources
50%
Confidence
Long-term
Relevance
10/16/2026
First Seen
Sources
Related Entities
Related Claims
VerifiedParameter-efficient fine-tuning (PEFT) methods such as LoRA have significantly lowered the compute barrier for fine-tuning, enabling individual developers to complete fine-tuning on consumer-grade GPUs.71% similarUnverifiedLoRA's parameter count, memory usage and optimization difficulty grow linearly with the rank r, rather than quadratically with the model width.70% similarVerifiedDuring LoRA fine-tuning, the original model parameters are frozen and only the inserted low-rank matrices are updated, significantly reducing VRAM requirements and training costs.70% similarUnverifiedParameter-efficient fine-tuning (PEFT) methods such as LoRA update only a small number of additional parameters, reducing the demands on compute and data volume.68% similarUnverified梯度下降的权重更新规则为 w = w - lr * gradient，其中lr是学习率66% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1047753API
curl https://kongchang.com/api/v1/knowledge/claims/1047753MCP
get_claim(id=1047753)