Unverified50% confidenceFactExact time
Step decay lowers the learning rate by a fixed ratio (e.g., multiplying by 0.1) at preset iteration points; it is simple to implement and predictable in behavior, and is an open-loop, empirically driven schedule.
1
Sources
50%
Confidence
Long-term
Relevance
10/27/2026
First Seen
Sources
Related Entities
Related Claims
VerifiedGradient descent has spawned three main variants — batch gradient descent, stochastic gradient descent, and mini-batch gradient descent — and the Adam optimizer is a combined improvement built on momentum and adaptive learning rates.78% similarUnverifiedMini-batch gradient descent is a compromise between batch and stochastic gradient descent, and is also the most commonly used approach in deep learning frameworks.77% similarUnverified批量梯度下降使用全部训练数据计算梯度，随机梯度下降每次只用一个样本，小批量梯度下降在两者之间取得平衡76% similarUnverifiedAdaptive step-size control is a viable mitigation direction: write only a small number of positions per step in the early stages, and gradually increase the number of parallel writes as dependencies weaken.76% similarUnverified梯度下降的收敛条件与学习率和损失函数的Lipschitz常数的关系有关76% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1102259API
curl https://kongchang.com/api/v1/knowledge/claims/1102259MCP
get_claim(id=1102259)