Verified70% confidenceFactTime unknown
Google validated the Mixture of Experts (MoE) architecture at scale in Switch Transformer.
4
Sources
70%
Confidence
Long-term
Relevance
5/31/2026
First Seen
Sources
Related Entities
Related Claims
Unverified2022年Google的《Switch Transformers》将MoE中选Top-K专家简化为选Top-1专家，并通过辅助负载均衡损失函数解决专家坍塌问题80% similarUnverifiedMoE混合专家架构最早可追溯至1991年的学术论文，谷歌于2021年发布Switch Transformer将专家数量扩展至2048个78% similarVerifiedGoogle's Switch Transformer, released in 2021, alleviates load imbalance by simplifying routing to a Top-1 selection and introducing an expert capacity mechanism.76% similarVerifiedThe MoE architecture was proposed by Shazeer et al. in 2017 in the paper "Outrageously Large Neural Networks" and subsequently validated at scale by Google in Switch Transformer (2021)76% similarVerifiedThe modern form of MoE can be traced back to a Google paper in 2017, and in 2022 Google's Switch Transformer demonstrated that trillion-parameter sparse models can be trained efficiently.74% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/4433API
curl https://kongchang.com/api/v1/knowledge/claims/4433MCP
get_claim(id=4433)