Verified90% confidenceFactExact time
Knowledge Distillation is a technique for transferring knowledge from a large teacher model to a smaller student model, proposed by Geoffrey Hinton et al. in 2015
12
Sources
90%
Confidence
Long-term
Relevance
8/2/2026
First Seen
Sources
AI Tool Mashups in Practice: Combining Model Layering with Intelligent CLI
Related Entities
Related Claims
Verified知识蒸馏由Hinton等人在2015年提出，核心思想是让小型学生模型模仿大型教师模型的输出分布71% similarUnverifiedThe core difference between self-distillation and traditional knowledge distillation is that the teacher and student can be the same model, or outputs produced by the model itself at different training stages or from different perspectives.68% similarUnverified知识蒸馏最早由Hinton等人在2015年提出，DiffusionGemma创造性地将其用于步数压缩，教师模型用较多步数（如48步）生成，学生模型用更少步数（如12步）达到相近质量67% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/679829API
curl https://kongchang.com/api/v1/knowledge/claims/679829MCP
get_claim(id=679829)