Unverified50% confidenceOpinionExact time
Gradient checkpointing and ZeRO reduce average memory along two dimensions—single-GPU activations and cross-GPU state—respectively, but neither schedules for instantaneous peaks within a training step.
1
Sources
50%
Confidence
Long-term
Relevance
11/18/2026
First Seen
Sources
Related Entities
Related Claims
Cite This Claim
Stable URI
https://kongchang.com/claim/1183483API
curl https://kongchang.com/api/v1/knowledge/claims/1183483MCP
get_claim(id=1183483)