Unverified50% confidenceFactExact time
AdamW's default value of β₁ is usually 0.9, controlling the exponential moving average window of the first-order gradient.
1
Sources
50%
Confidence
Long-term
Relevance
10/15/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedAdam的一阶矩衰减系数β₁通常默认为0.973% similarUnverifiedAdamW's effective step size is approximately proportional to η/(1-β₁), so simply increasing β₁ amounts to implicitly amplifying the effective learning rate.71% similarUnverifiedWhen ε ≈ 0, the second-moment estimate fully dominates and the optimizer reverts to standard Adam.65% similarUnverifiedOn the Qwen2.5-32B model, merely increasing AdamW's first-order momentum coefficient β₁ from its conventional value brought nearly a 2 percentage point improvement in average validation accuracy, without modifying other hyperparameters.64% similarUnverifiedAdam的二阶矩估计记录梯度平方的指数移动平均，反映梯度的波动幅度61% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1032945API
curl https://kongchang.com/api/v1/knowledge/claims/1032945MCP
get_claim(id=1032945)