Unverified50% confidenceFactExact time
'Model collapse' refers to a phenomenon in which language models, repeatedly trained on a mixture containing large amounts of synthetic text generated by similar models, gradually lose the ability to learn low-frequency real-world knowledge, produce increasingly homogeneous outputs, and significantly degrade after several iterations.
1
Sources
50%
Confidence
Long-term
Relevance
9/19/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedSynthetic data used to train large language models carries the risk of 'Model Collapse'.80% similarVerifiedModel collapse refers to the phenomenon whereby, after an AI model is trained on data generated by a previous-generation model, the output distribution gradually deviates from the original real data distribution across multiple generations of iteration, losing information in the tail of the distribution.76% similarUnverified模式坍缩是生成模型领域的经典难题，指模型对同一开放性问题反复给出高度雷同的答案73% similarUnverifiedThe capability degradation phenomenon (also known as 'model collapse') has been observed multiple times when fine-tuning with synthetic data generated by the model itself.73% similarVerifiedWhen language models are repeatedly trained on data generated by themselves or similar models, systematic degradation occurs, with the diversity of model outputs decreasing with each generation and the tail information of the distribution gradually being lost.73% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/934450API
curl https://kongchang.com/api/v1/knowledge/claims/934450MCP
get_claim(id=934450)