Unverified50% confidenceFactExact time
GPT-2采用纯解码器的Transformer堆叠结构，去掉了编码器-解码器的交叉注意力部分，专注于单向自回归语言建模
1
Sources
50%
Confidence
Long-term
Relevance
7/15/2026
First Seen
Sources
Related Claims
UnverifiedThe Transformer architecture has diverged into two major lineages: BERT-style (Encoder-only, suited for understanding tasks) and GPT-style (Decoder-only, suited for generation tasks)78% similarUnverifiedModern large language models (such as the GPT series) almost universally adopt a decoder-only architecture, using masked self-attention to ensure that autoregressive generation does not leak future token information.77% similarUnverified现代LLM普遍采用的GPT架构本质上是仅使用Transformer解码器（Decoder-only）部分的自回归语言模型77% similarVerifiedThe GPT series uses the Decoder-only variant of the Transformer, predicting the next Token autoregressively.76% similarPartially VerifiedThe GPT series adopts a Decoder-only architecture.74% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/514341API
curl https://kongchang.com/api/v1/knowledge/claims/514341MCP
get_claim(id=514341)