Unverified60% confidenceFactTime unknown
Gemma 4 26B MOE版本总参数量为25.2B，但推理时仅激活约3.8B参数
2
Sources
60%
Confidence
Medium-term (~90 days)
Relevance
7/2/2026
First Seen
Valid until: 9/30/2026
Sources
Related Claims
Unverified千问3.6的35B MOE模型每次只激活其中3B的参数75% similarVerifiedGemma 4的26B MOE模型采用混合专家架构，拥有260亿总参数但任意时刻仅约40亿参数处于激活状态75% similarUnverified小米MiMo采用混合专家（MoE）架构，总参数量为24.6B，每次推理仅激活约5.3B参数74% similarUnverified千问三235B MoE总参数量2350亿，但每次推理实际激活的参数约22B73% similarUnverifiedMoE模型中'35B'指总参数量，每个token只激活少量Expert（通常2-4个），实际计算量可能仅相当于6-7B的Dense模型73% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/57144API
curl https://kongchang.com/api/v1/knowledge/claims/57144MCP
get_claim(id=57144)