Verified65% confidenceFactExact time
The MoE architecture concept can be traced back to the 1990s, was reignited in the large model era by Google's Switch Transformer, and has been validated by projects such as Mixtral and GPT-4.
3
Sources
65%
Confidence
Long-term
Relevance
7/11/2026
First Seen
Sources
Grok 4.5 Hands-On: A Faster, Cheaper Coding Dark Horse — Can It Replace Opus and GPT?
youtubeForrestKnight7/10/2026
Related Claims
VerifiedThe MoE architecture was first proposed by Jacobs et al. in 1991 and in recent years has been brought back into the mainstream by models such as Google's Switch Transformer and Mixtral.80% similarVerifiedThe core idea of MoE (Mixture of Experts) can be traced back to the early mixture of experts framework proposed by Jacobs et al. in 1991, and Google's Switch Transformer in 2021 brought it into the era of large-scale language models.78% similarUnverifiedThe MoE architecture was first systematically introduced into the Transformer framework by Google and was subsequently advanced by leading Chinese model companies.76% similarVerifiedThe modern form of MoE can be traced back to a Google paper in 2017, and in 2022 Google's Switch Transformer demonstrated that trillion-parameter sparse models can be trained efficiently.74% similarUnverifiedMoE混合专家架构最早可追溯至1991年的学术论文，谷歌于2021年发布Switch Transformer将专家数量扩展至2048个74% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/488036API
curl https://kongchang.com/api/v1/knowledge/claims/488036MCP
get_claim(id=488036)