Unverified50% confidenceFactExact time
AdamW's effective step size is approximately proportional to η/(1-β₁), so simply increasing β₁ amounts to implicitly amplifying the effective learning rate.
1
Sources
50%
Confidence
Long-term
Relevance
10/15/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedOn the Qwen2.5-32B model, merely increasing AdamW's first-order momentum coefficient β₁ from its conventional value brought nearly a 2 percentage point improvement in average validation accuracy, without modifying other hyperparameters.72% similarUnverifiedWhen ε ≈ 0, the second-moment estimate fully dominates and the optimizer reverts to standard Adam.72% similarUnverifiedAdamW's default value of β₁ is usually 0.9, controlling the exponential moving average window of the first-order gradient.71% similarUnverifiedAdam的一阶矩衰减系数β₁通常默认为0.970% similarUnverifiedAdam 优化器由 Kingma 和 Ba 于 2014 年提出，同时维护梯度的一阶矩估计与二阶矩估计，并通过偏差修正项处理训练初期矩估计偏向零的问题66% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1032947API
curl https://kongchang.com/api/v1/knowledge/claims/1032947MCP
get_claim(id=1032947)