Unverified50% confidenceFactExact time
BPE (Byte Pair Encoding) was originally proposed by Philip Gage in 1994 for data compression, later introduced into NLP by OpenAI, and is currently the most commonly used tokenization algorithm in mainstream LLMs.
1
Sources
50%
Confidence
Long-term
Relevance
9/11/2026
First Seen
Sources
Related Entities
Related Claims
Unverified字节对编码(BPE)算法最初由Sennrich等人于2016年引入NLP领域，OpenAI的tiktoken分词器基于此原理74% similarUnverifiedOpenAI系列模型采用BPE（字节对编码）算法进行分词，起源于数据压缩领域74% similarVerifiedOpenAI uses the BPE (Byte Pair Encoding) algorithm for token encoding.62% similarUnverifiedPrompt Engineering has become a dedicated technical direction, and institutions such as OpenAI and Google DeepMind have published systematic best practice guides.58% similarUnverifiedOpenTelemetry (OTel) is an open-source standard led by the CNCF Foundation and is being progressively introduced into LLM applications to standardize data collection formats.58% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/892969API
curl https://kongchang.com/api/v1/knowledge/claims/892969MCP
get_claim(id=892969)