Unverified90% confidenceFactTime unknown
AdaGrad通过累积历史梯度平方实现自适应，但会导致学习率单调递减直至停止更新
1
Sources
90%
Confidence
Long-term
Relevance
5/31/2026
First Seen
Sources
Adam优化器深度拆解：一文搞懂自适应矩估计原理
bilibili深度学习自习室
Related Entities
Related Claims
VerifiedThe Ebbinghaus forgetting curve reveals that memory strength decays exponentially over time, and this process can be slowed through spaced repetition.67% similarUnverifiedGradient descent has spawned three main variants — batch gradient descent, stochastic gradient descent, and mini-batch gradient descent — and the Adam optimizer is a combined improvement built on momentum and adaptive learning rates.65% similarUnverified梯度下降的收敛条件与学习率和损失函数的Lipschitz常数的关系有关65% similarUnverifiedCosine annealing allows the learning rate to smoothly decrease along a cosine curve to near zero and periodically restart, which was formalized by the SGDR algorithm.64% similarUnverified梯度下降的权重更新规则为 w = w - lr * gradient，其中lr是学习率64% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/7718API
curl https://kongchang.com/api/v1/knowledge/claims/7718MCP
get_claim(id=7718)