Verified70% confidenceFactExact time
BPE (Byte Pair Encoding) was introduced into the NLP field by Sennrich et al. in 2016.
4
Sources
70%
Confidence
Long-term
Relevance
7/6/2026
First Seen
Sources
Is Claude Sonnet 5 Really Cheap? A Cost Breakdown by Task
bilibili为什么叫QQ7/1/2026
Related Claims
VerifiedThe widespread application of the BPE algorithm in NLP began in 2016 when Sennrich et al. introduced it into neural machine translation.81% similarVerifiedThe BPE (Byte Pair Encoding) algorithm was originally introduced into NLP by Sennrich et al. in 2016, and is essentially a lossless data compression technique.80% similarVerifiedBPE was originally a data compression algorithm that was introduced into NLP in 2016 for subword segmentation in neural machine translation.72% similarVerifiedBPE（Byte Pair Encoding）是大语言模型使用的Token化算法，通过统计训练语料中字符对的共现频率迭代合并最常见的字符组合68% similarUnverified在OpenAI的tiktoken和Google的SentencePiece等现代分词器中，BPE已进化为BBPE（Byte-level BPE），直接在UTF-8字节层面操作67% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/113287API
curl https://kongchang.com/api/v1/knowledge/claims/113287MCP
get_claim(id=113287)