Unverified60% confidenceFactTime unknown
Google's Noisy Student Training demonstrated around 2020 the effectiveness of using a teacher model to generate pseudo-labels for training a student model.
2
Sources
60%
Confidence
Long-term
Relevance
6/3/2026
First Seen
Sources
Related Entities
Related Claims
VerifiedKnowledge distillation was first proposed by Hinton, Vinyals, and Dean at Google in 2015, with the core idea of having a small student model learn from the soft labels output by a large teacher model.66% similarUnverified卡内基梅隆大学开发的Cognitive Tutor引入产生式规则模型和学生模型，在代数教学中取得约0.4 SD的持续效果，被美国数千所学校部署61% similarVerified知识蒸馏由Hinton等人在2015年提出，核心思想是让小型学生模型模仿大型教师模型的输出分布60% similarUnverifiedRAPID dynamically identifies critical sample pairs using calibrated teacher entropy and teacher-student residuals60% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/39211API
curl https://kongchang.com/api/v1/knowledge/claims/39211MCP
get_claim(id=39211)