Unverified50% confidenceBenchmarkExact time
For modern models, processing post-1918 vocabulary consumes approximately 3.1 more bits per byte than processing historical vocabulary, whereas this gap does not exist for historical models.
1
Sources
50%
Confidence
Long-term
Relevance
10/9/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedFor the historical Polish period from 1800 to 1918, only approximately one million words have been compiled into machine-readable annotated corpora.63% similarUnverified最新的大语言模型支持12.8万到100万token的上下文，但处理数十万字长篇小说时仍会出现信息遗忘和前后矛盾63% similarUnverified大语言模型以token为单位处理文字而非以字母为单位，这解释了早期模型在字母计数任务上出错62% similarUnverifiedThe researchers acknowledge that the model still falls far short of classical language models trained on trillions of tokens on text tasks.62% similarUnverified早期模型的上下文窗口仅有4K至8K个Token，约3000至6000个英文单词62% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/990275API
curl https://kongchang.com/api/v1/knowledge/claims/990275MCP
get_claim(id=990275)