Unverified50% confidenceFactExact time
使用Adam优化器时，每参数需要16字节状态信息（FP32参数4字节+FP32梯度4字节+一阶动量4字节+二阶动量4字节），15亿参数模型每个GPU至少需约24GB状态信息
1
Sources
50%
Confidence
Long-term
Relevance
8/26/2026
First Seen
Sources
Related Entities
Related Claims
Cite This Claim
Stable URI
https://kongchang.com/claim/802589API
curl https://kongchang.com/api/v1/knowledge/claims/802589MCP
get_claim(id=802589)