Unverified50% confidenceTradeoffExact time
The file size and VRAM usage of a MoE model depend on the total parameter count rather than the activated parameter count, because all expert weights need to be stored.
1
Sources
50%
Confidence
Long-term
Relevance
9/3/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedMoE模型采用稀疏激活，Qwen 3.5 122B总参数122B但每次推理仅激活约10B，需将全部参数加载进内存，对内存容量极度敏感63% similarUnverifiedFP16格式下，大模型显存需求的估算公式为：参数量 × 2 = 所需显存（GB），即每个参数以16位（2字节）浮点数存储62% similarUnverified激活参数描述的是每个 token 的计算量，而非权重的存储需求62% similarUnverifiedCombining MoE with quantization technology can make it possible for a laptop with 16 GB of memory to run MoE models with tens of billions of parameters.60% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/850086API
curl https://kongchang.com/api/v1/knowledge/claims/850086MCP
get_claim(id=850086)