Expired50% confidenceFactExact time
All mainstream large models, including ChatGPT, DeepSeek, Tongyi Qianwen, Doubao, Wenxin, Claude, and Gemini, are trained based on the Transformer architecture.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
7/20/2026
First Seen
Valid until: 10/18/2026(expired)
Sources
Related Claims
UnverifiedThe core innovation of the Transformer is the self-attention mechanism, and mainstream large models such as GPT, Claude, and Gemini are all built on the Transformer.76% similarUnverifiedBERT、GPT系列、T5等预训练大模型均以Transformer为基础架构，形成了预训练+微调的主流范式74% similarUnverifiedGPT系列、LLaMA、Gemini等主流模型均基于Transformer的解码器（Decoder-only）变体71% similarVerifiedModern large models (such as the GPT series, Qwen, and DeepSeek) generally adopt the Decoder-only variant of the Transformer71% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/571310API
curl https://kongchang.com/api/v1/knowledge/claims/571310MCP
get_claim(id=571310)