Unverified50% confidenceFactExact time
Transformer架构分化为BERT类(Encoder-only,适合理解任务)和GPT类(Decoder-only,适合生成任务)两大路线
1
Sources
50%
Confidence
Long-term
Relevance
7/19/2026
First Seen
Sources
Related Claims
UnverifiedGPT-2采用纯解码器的Transformer堆叠结构,去掉了编码器-解码器的交叉注意力部分,专注于单向自回归语言建模78% similarPartially VerifiedTransformers come in three variants: encoder-only (like BERT), decoder-only (like GPT), and encoder-decoder (like T5)76% similarVerifiedGPT、BERT、ChatGPT等现代AI系统均以Transformer为核心架构75% similarUnverified现代LLM普遍采用的GPT架构本质上是仅使用Transformer解码器(Decoder-only)部分的自回归语言模型75% similarPartially VerifiedGPT系列采用了仅解码器(Decoder-only)架构74% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/560047API
curl https://kongchang.com/api/v1/knowledge/claims/560047MCP
get_claim(id=560047)