Unverified50% confidenceFactExact time
Under a local quadratic model, a larger batch means fewer but longer update steps, with each step incurring a greater loss on curvature, resulting in a critical batch size that depends on the learning rate, beyond which sample efficiency declines.
1
Sources
50%
Confidence
Long-term
Relevance
10/14/2026
First Seen
Sources
Related Entities
Related Claims
VerifiedThe learning rate determines how large each step is: too large causes overshooting the valley bottom and divergence, while too small makes training extremely time-consuming.78% similarUnverified数据规模的增长并不等同于有效学习信号的增长，在模型能力提升到一定阈值后简单堆砌样本的收益会急剧下降78% similarUnverifiedThe double descent phenomenon occurs not only along the model size dimension, but can also appear with changes in training epochs and data volume.77% similarVerifiedSmaller models often show exponential rather than linear degradation in performance on long reasoning chain tasks.77% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1027461API
curl https://kongchang.com/api/v1/knowledge/claims/1027461MCP
get_claim(id=1027461)