Unverified50% confidenceFactExact time
Switch Transformer将专家数量扩展至2048个，2022年谷歌GLaM模型进一步验证了MoE在多任务泛化上的优势
1
Sources
50%
Confidence
Long-term
Relevance
7/25/2026
First Seen
Sources
中国开源大模型如何逼近美国闭源巨头？
Related Claims
VerifiedGoogle's Switch Transformer, released in 2021, applied MoE at scale to Transformer language models, expanding model capacity to the trillion-parameter level.83% similarUnverifiedSwitch Transformer, proposed in 2021, simplified the number of experts routed to per token to 1.80% similarUnverifiedGshard（2020）首次实现了万亿参数MoE模型的分布式训练，Switch Transformer（2022）将每个token的路由选择收敛为单一专家77% similarVerifiedGoogle proposed the Transformer architecture in 2017, BERT emerged in 2018, and the GPT series of models appeared after 2020, pushing NLP into the era of large models with pre-training plus fine-tuning.69% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/615611API
curl https://kongchang.com/api/v1/knowledge/claims/615611MCP
get_claim(id=615611)