Unverified50% confidenceFactExact time
The BPE (Byte Pair Encoding) algorithm was originally proposed by Philip Gage in 1994 for data compression, and was later introduced by OpenAI into the NLP domain for tokenization in the GPT series of models.
1
Sources
50%
Confidence
Long-term
Relevance
9/6/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedThe BPE tokenization algorithm was originally introduced by OpenAI in GPT-278% similarUnverifiedBoth the GPT series and the Claude series employ a tokenization mechanism similar to Byte-Pair Encoding (BPE).65% similarVerifiedGPT is a series of large language models developed by OpenAI based on the Transformer architecture64% similarVerifiedThe GPT series uses tiktoken (based on BPE encoding) for tokenization.63% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/866074API
curl https://kongchang.com/api/v1/knowledge/claims/866074MCP
get_claim(id=866074)