Unverified50% confidenceFactExact time
Related research has already observed a degradation trend of model collapse in modalities such as text and images, that is, AI-generated content flowing back causes the proportion of synthetic text in subsequent model training corpora to rise and the distribution to deviate from real-world data.
1
Sources
50%
Confidence
Long-term
Relevance
10/20/2026
First Seen
Sources
Related Entities
Related Claims
Unverified'Model collapse' refers to a phenomenon in which language models, repeatedly trained on a mixture containing large amounts of synthetic text generated by similar models, gradually lose the ability to learn low-frequency real-world knowledge, produce increasingly homogeneous outputs, and significantly degrade after several iterations.79% similarVerifiedModel collapse refers to the phenomenon whereby, after an AI model is trained on data generated by a previous-generation model, the output distribution gradually deviates from the original real data distribution across multiple generations of iteration, losing information in the tail of the distribution.76% similarUnverifiedThe capability degradation phenomenon (also known as 'model collapse') has been observed multiple times when fine-tuning with synthetic data generated by the model itself.74% similarVerifiedWhen language models are repeatedly trained on data generated by themselves or similar models, systematic degradation occurs, with the diversity of model outputs decreasing with each generation and the tail information of the distribution gradually being lost.73% similarUnverified2023年牛津大学Ilia Shumailov团队在Nature上发表研究系统阐述了模型崩溃效应，指出模型在自身生成数据上迭代训练相当于对原始数据分布有损压缩71% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1075910API
curl https://kongchang.com/api/v1/knowledge/claims/1075910MCP
get_claim(id=1075910)