Unverified50% confidenceFactExact time
A token roughly corresponds to one word or part of a word.
1
Sources
50%
Confidence
Long-term
Relevance
10/17/2026
First Seen
Sources
Related Entities
Related Claims
Unverified维特根斯坦的语言游戏理论指出语词的意义取决于其在特定语境中的使用方式65% similarUnverifiedSubword Level tokenization splits words into smaller units such as roots and affixes, and can better handle new words and technical terminology.65% similarUnverifiedAI偏爱某些特定词汇如tapestry、delve、testament等,这些词在人类日常写作中出现频率不高64% similarUnverifiedThe emergence of pejorative slang often represents a group's completion of disenchantment with something at the linguistic level.64% similarUnverified传统关键词匹配依赖词频统计(TF-IDF)或倒排索引,只能理解字面含义61% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1054920API
curl https://kongchang.com/api/v1/knowledge/claims/1054920MCP
get_claim(id=1054920)