Expired60% confidenceFactTime unknown
Google's Switch Transformer uses an Auxiliary Load Balancing Loss to address the expert load imbalance problem in MoE.
2
Sources
60%
Confidence
Medium-term (~90 days)
Relevance
7/2/2026
First Seen
Valid until: 9/30/2026(expired)
Sources
Related Claims
UnverifiedMoE 通过辅助负载均衡损失（Auxiliary Load Balancing Loss）来缓解专家坍塌问题73% similarUnverifiedThe original paper on Switch Transformer discusses the design of introducing auxiliary loss functions to enforce uniform distribution among experts.62% similarUnverified现代 MoE 实现通过辅助损失函数解决专家崩溃/负载均衡问题61% similarUnverifiedThe MoE architecture is subject to the Expert Collapse phenomenon, and researchers have introduced auxiliary loss functions to force the dispersal of routing choices.58% similarUnverifiedSwitch Transformer将每个Token的专家选择简化为Top-1，并引入辅助损失函数防止Token涌向少数热门专家58% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/61137API
curl https://kongchang.com/api/v1/knowledge/claims/61137MCP
get_claim(id=61137)