Unverified50% confidenceFactExact time
During pretraining, the model learns only statistical patterns in text through the next-token prediction objective; no label tells it which statements are true and which are false.
1
Sources
50%
Confidence
Long-term
Relevance
10/18/2026
First Seen
Sources
Related Entities
Related Claims
VerifiedThe root cause of citation hallucination is that LLMs learn linguistic patterns by predicting the next word, and no factual database for real-time verification is embedded in the training process.76% similarUnverifiedUsing next-word prediction as a mental model for understanding LLM capabilities is incomplete, as the training objective cannot fully describe the internal representations the model has acquired.74% similarUnverified预训练阶段的下一词预测目标让模型倾向生成自然流畅序列，而JSON等结构化格式在通用网络语料中占比有限，导致模型偶发格式违规74% similarUnverifiedZero-shot learning refers to a model making predictions at inference time without relying on any labeled samples for the task, directly based on pre-trained knowledge or external structural information.73% similarVerified大语言模型的预训练阶段本质上属于自监督学习，是一种特殊的非监督学习，模型通过预测下一个词来从海量文本中自动学习语言规律73% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1063179API
curl https://kongchang.com/api/v1/knowledge/claims/1063179MCP
get_claim(id=1063179)