Verified70% confidenceFactExact time
MoE was reactivated in the era of large language models by Google's Switch Transformer (2021) and GLaM.
4
Sources
70%
Confidence
Long-term
Relevance
7/24/2026
First Seen
Sources
Related Claims
VerifiedThe modern form of MoE can be traced back to a Google paper in 2017, and in 2022 Google's Switch Transformer demonstrated that trillion-parameter sparse models can be trained efficiently.80% similarVerifiedThe core idea of MoE (Mixture of Experts) can be traced back to the early mixture of experts framework proposed by Jacobs et al. in 1991, and Google's Switch Transformer in 2021 brought it into the era of large-scale language models.79% similarVerifiedThe Transformer architecture proposed by Google in 2017 laid the foundation for large language models.78% similarUnverifiedGoogle's Switch Transformer and GLaM were the first to scale MoE to the trillion-parameter level.75% similarUnverifiedMoE混合专家架构最早可追溯至1991年的学术论文，谷歌于2021年发布Switch Transformer将专家数量扩展至2048个74% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/604954API
curl https://kongchang.com/api/v1/knowledge/claims/604954MCP
get_claim(id=604954)