Unverified50% confidenceFactExact time
Distributional truncation was systematically documented in corpus research in linguistics and coarse-grained modeling in statistical physics long before the current context.
1
Sources
50%
Confidence
Long-term
Relevance
10/8/2026
First Seen
Sources
Related Entities
Related Claims
VerifiedWhen language models are repeatedly trained on data generated by themselves or similar models, systematic degradation occurs, with the diversity of model outputs decreasing with each generation and the tail information of the distribution gradually being lost.71% similarUnverified分布假说指出意义相近的词出现在相似的上下文中，导致反义词在Word2Vec、GloVe、BERT等模型中学到相近的表征方向70% similarUnverifiedComputational linguistics went through a paradigm shift from rule-based systems to statistical methods (Hidden Markov Models and n-gram language models in the 1990s), and then to deep learning dominance.69% similarVerifiedCurrent large language models and generative models are fundamentally seeking statistical patterns in massive amounts of data66% similarUnverifiedA language model's understanding of sequence features is statistical rather than based on explicit biochemical rules, which may simultaneously produce both creative and obviously erroneous predictions.65% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/989859API
curl https://kongchang.com/api/v1/knowledge/claims/989859MCP
get_claim(id=989859)