Unverified50% confidenceFactExact time
A token is the basic unit of text processed by an LLM, and it can be a complete word, part of a word, punctuation, or a space.
1
Sources
50%
Confidence
Long-term
Relevance
10/13/2026
First Seen
Sources
Related Entities
Related Claims
VerifiedToken是大语言模型处理文本的基本计量单位，由BPE（字节对编码）等分词算法生成77% similarVerifiedA token is the basic unit of billing for large models and is essentially the smallest semantic segment after text is split.76% similarVerifiedTokens are the basis for billing by large models; they are produced by a tokenizer splitting raw text and are the basic unit by which large models process text.73% similarUnverified在基于 LLM 的 AI 编程助手中，Token 是计算成本的基本单位，输入和输出文本都会被切分为 Token 计费70% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1019010API
curl https://kongchang.com/api/v1/knowledge/claims/1019010MCP
get_claim(id=1019010)