Unverified60% confidenceFactExact time
After the Transformer architecture emerged in 2017, Google, OpenAI, Meta, and other organizations each completed their own preliminary research on large language models based on this architecture within roughly the same year.
2
Sources
60%
Confidence
Long-term
Relevance
7/25/2026
First Seen
Sources
Related Claims
Partially VerifiedTransformer架构于2017年提出，是自然语言编程真正落地的转折点之一71% similarVerifiedGoogle's Switch Transformer, released in 2021, applied MoE at scale to Transformer language models, expanding model capacity to the trillion-parameter level.70% similarVerifiedGoogle proposed the Transformer architecture in 2017, BERT emerged in 2018, and the GPT series of models appeared after 2020, pushing NLP into the era of large models with pre-training plus fine-tuning.68% similarUnverifiedSwitch Transformer将专家数量扩展至2048个，2022年谷歌GLaM模型进一步验证了MoE在多任务泛化上的优势66% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/613170API
curl https://kongchang.com/api/v1/knowledge/claims/613170MCP
get_claim(id=613170)