Unverified50% confidenceFactExact time
批量梯度下降使用全部训练数据计算梯度，随机梯度下降每次只用一个样本，小批量梯度下降在两者之间取得平衡
1
Sources
50%
Confidence
Long-term
Relevance
8/12/2026
First Seen
Sources
Related Claims
Unverified在稠密检索中，批内负样本训练要求批次包含有信息量的负样本，随机采样会导致训练损失快速收敛但泛化性能差76% similarUnverifiedGradient accumulation accumulates gradients over multiple small batches before performing a single parameter update, with an effect equivalent to training with a large batch.74% similarUnverifiedGradient descent has spawned three main variants — batch gradient descent, stochastic gradient descent, and mini-batch gradient descent — and the Adam optimizer is a combined improvement built on momentum and adaptive learning rates.74% similarUnverifiedGradient descent has three variants: batch gradient descent, stochastic gradient descent (SGD), and mini-batch gradient descent.73% similarUnverifiedCopilot 基于统计模式预测，训练数据中出现频次较低的技术配置生成质量会显著下降72% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/735103API
curl https://kongchang.com/api/v1/knowledge/claims/735103MCP
get_claim(id=735103)