Unverified50% confidenceFactExact time
GPT-2的BPE在字节级别操作，其merge表包含约5万条规则，最终词表为50,257个token
1
Sources
50%
Confidence
Long-term
Relevance
8/20/2026
First Seen
Sources
Related Claims
VerifiedGPT-3 has a vocabulary of approximately 50,000 tokens.78% similarUnverifiedGPT-2的词表规模约5万，GPT-2 small架构为12层、每层12个注意力头76% similarUnverifiedGPT series models use byte-level BPE (Byte-level BPE), which takes raw bytes as the basic unit to eliminate the out-of-vocabulary character problem.72% similarUnverifiedGPT 系列模型的词表通常包含约 50,000–100,000 个 token72% similarUnverifiedEnterprise-level GPT system instructions are typically 2,000–5,000 words long and require repeated testing of edge cases.72% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/777379API
curl https://kongchang.com/api/v1/knowledge/claims/777379MCP
get_claim(id=777379)