Unverified50% confidenceFactExact time
In the sampled-gradient setting, when the learning rate η decreases, the expected gain under fixed β vanishes faster than the fluctuation itself, causing the benefit of momentum to be swallowed by noise.
1
Sources
50%
Confidence
Long-term
Relevance
10/15/2026
First Seen
Sources
Related Entities
Related Claims
VerifiedThe learning rate determines how large each step is: too large causes overshooting the valley bottom and divergence, while too small makes training extremely time-consuming.80% similarUnverified数据规模的增长并不等同于有效学习信号的增长，在模型能力提升到一定阈值后简单堆砌样本的收益会急剧下降79% similarUnverifiedUnder a local quadratic model, a larger batch means fewer but longer update steps, with each step incurring a greater loss on curvature, resulting in a critical batch size that depends on the learning rate, beyond which sample efficiency declines.78% similarUnverifiedUnconstrained recursive self-improvement can lead to performance drift, runaway costs, and even contamination of training data through leakage.77% similarUnverifiedStandard reinforcement learning algorithms propagate rewards based on temporal proximity rather than explicit relevance, causing the learning signal for early actions that are temporally distant but decisively important to be severely attenuated.75% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1032935API
curl https://kongchang.com/api/v1/knowledge/claims/1032935MCP
get_claim(id=1032935)