Unverified50% confidenceFactExact time
Beam uses a sparse mixture-of-experts (MoE) architecture, activating 23 billion parameters per token.
1
Sources
50%
Confidence
Long-term
Relevance
10/17/2026
First Seen
Sources
Related Entities
Related Claims
VerifiedThe Mixture of Experts (MoE) architecture activates only the most relevant expert sub-networks through a routing mechanism (typically 1/8 to 1/4 of total parameters); both Mistral's Mixtral and Google's Gemini 1.5 adopt this architecture.60% similarUnverifiedAnt Group launched Ling-3.1-flash, with approximately 560 billion total parameters, using a MoE architecture that activates only approximately 25 billion parameters per token, with a context limit of 1 million.59% similarVerifiedGoogle Gemini 1.5 Pro 支持最高 100 万 token 的上下文窗口并具备原生多模态能力57% similarUnverifiedThe Gemini API implements a 1 million unified input-output token limit.57% similarUnverifiedGoogle的Gemini和Mistral的Mixtral采用了混合专家（MoE）架构，在推理时只激活部分参数57% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1053611API
curl https://kongchang.com/api/v1/knowledge/claims/1053611MCP
get_claim(id=1053611)