Unverified50% confidenceFactExact time
GShard于2020年首次在Transformer中实现了600B参数的MoE训练
1
Sources
50%
Confidence
Long-term
Relevance
8/18/2026
First Seen
Sources
Gemini 3.5 Pro变身3.7 Flash？大模型命名迷局解析
Related Claims
UnverifiedGoogle 2017年提出的Sparsely-Gated MoE首次将稀疏门控引入Transformer规模的序列模型，可在不显著增加计算量前提下将模型容量扩大1000倍以上59% similarUnverifiedThe Hopper architecture of the H100 introduced a dedicated Transformer Engine supporting FP8 precision computation.59% similarUnverifiedBlackwell's second-generation Transformer Engine adds FP4 precision support, which in theory can improve Transformer model training throughput by 2–4x compared to the H100.58% similarVerifiedThe Transformers library is maintained by Hugging Face and provides a unified interface for thousands of pre-trained models58% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/768300API
curl https://kongchang.com/api/v1/knowledge/claims/768300MCP
get_claim(id=768300)