Unverified50% confidenceFactExact time
AllReduce在每个训练迭代反向传播结束后要求所有GPU同步梯度，这一步骤在数千卡规模下可能消耗数十毫秒甚至更长时间
1
Sources
50%
Confidence
Long-term
Relevance
10/6/2026
First Seen
Sources
Related Entities
Cite This Claim
Stable URI
https://kongchang.com/claim/982243API
curl https://kongchang.com/api/v1/knowledge/claims/982243MCP
get_claim(id=982243)