Expired75% confidenceFactTime unknown
After the successful deployment of MoE models represented by Google Switch Transformer and Mixtral, the MoE architecture has become the mainstream technical choice for ultra-large-scale language models.
5
Sources
75%
Confidence
Medium-term (~90 days)
Relevance
7/2/2026
First Seen
Valid until: 9/30/2026(expired)
Sources
GLM5 Architecture Leaked: 745B Parameters, DeepSeek V4 May Launch Quantized Smaller Model First
bilibiliinfinite灵感港
Related Claims
VerifiedMoE was reactivated in the era of large language models by Google's Switch Transformer (2021) and GLaM.81% similarVerifiedThe Transformer architecture proposed by Google in 2017 laid the foundation for large language models.79% similarUnverifiedThe MoE architecture was first systematically introduced into the Transformer framework by Google and was subsequently advanced by leading Chinese model companies.77% similarVerifiedGoogle's Switch Transformer and Mistral's Mixtral 8x7B are typical representatives of the MoE architecture.75% similarVerifiedThe core idea of MoE (Mixture of Experts) can be traced back to the early mixture of experts framework proposed by Jacobs et al. in 1991, and Google's Switch Transformer in 2021 brought it into the era of large-scale language models.75% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/55783API
curl https://kongchang.com/api/v1/knowledge/claims/55783MCP
get_claim(id=55783)