Unverified50% confidenceFactExact time
OpenAI 使用的 tiktoken 以及 Google 的 SentencePiece 均以 BPE 为基础
1
Sources
50%
Confidence
Long-term
Relevance
7/20/2026
First Seen
Sources
Related Claims
UnverifiedGoogle's Gemma series tokenizers are implemented using the SentencePiece framework and support both BPE and Unigram algorithms.70% similarUnverifiedThe technical path of Page Agent is highly similar to that of OpenAI's Computer Use, Google's Project Mariner, and Anthropic's Claude Computer Use.61% similarUnverifiedGoogle的Gemini采用SentencePiece框架配合Unigram语言模型算法进行分词60% similarUnverifiedLeading institutions including OpenAI and Google are actively researching text watermarking standards.60% similarUnverifiedSentencePiece was developed by Google and learns subword units directly from raw text without requiring a pre-tokenization step.60% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/570184API
curl https://kongchang.com/api/v1/knowledge/claims/570184MCP
get_claim(id=570184)