Model Collapse
A machine learning phenomenon in which an AI model, trained on data containing large volumes of AI-generated content, progressively diverges from the true distribution of human-produced data, resulting in degraded output quality, reduced diversity, and increased homogenization of generated content.
Core Facts
Model collapse refers to the phenomenon whereby, after an AI model is trained on data generated by a previous-generation model, the output distribution gradually deviates from the original real data distribution across multiple generations of iteration, losing information in the tail of the distribution.
模型坍缩（Model Collapse）概念在2023年由牛津大学和剑桥大学研究团队在Nature论文中正式提出
Timeline (last 90 days)
Model collapse refers to the phenomenon whereby, after an AI model is trained on data generated by a previous-generation model, the output distribution gradually deviates from the original real data distribution across multiple generations of iteration, losing information in the tail of the distribution.
The capability degradation phenomenon (also known as 'model collapse') has been observed multiple times when fine-tuning with synthetic data generated by the model itself.
In 2023, researchers from Oxford University and other institutions published a study finding that after only 5–10 generations of recursive training, the degradation in model output quality became visible to the naked eye.
All Facts (5)
Model collapse refers to the phenomenon whereby, after an AI model is trained on data generated by a previous-generation model, the output distribution gradually deviates from the original real data distribution across multiple generations of iteration, losing information in the tail of the distribution.
80%Verified模型坍缩（Model Collapse）概念在2023年由牛津大学和剑桥大学研究团队在Nature论文中正式提出
70%Unverified当生成模型反复在自身生成的数据上训练时，输出分布会逐渐退化，低概率事件被系统性遗忘
85%UnverifiedIn 2023, researchers from Oxford University and other institutions published a study finding that after only 5–10 generations of recursive training, the degradation in model output quality became visible to the naked eye.
60%UnverifiedThe capability degradation phenomenon (also known as 'model collapse') has been observed multiple times when fine-tuning with synthetic data generated by the model itself.
50%