Verified75% confidenceFactExact time
Knowledge distillation was systematized by Hinton et al. in 2015; its core idea is to transfer the dark knowledge of a large model to a small model, using soft probability distributions as supervision signals.
3
Sources
75%
Confidence
Long-term
Relevance
7/12/2026
First Seen
Sources
GPT-5.6 Sol Limited Preview: The Safety Boundaries Behind AI's Capability Expansion
bilibili江枫渔火AI7/9/2026
Related Claims
VerifiedKnowledge distillation was proposed by Hinton et al. in 2015, originally referring to training a small model using the soft label outputs of a large model.78% similarUnverifiedLightweight models are compressed in scale through knowledge distillation and model pruning techniques; knowledge distillation has the small model mimic the output probability distribution of the large model, while pruning removes network weights that contribute least to the output.76% similarUnverifiedKnowledge distillation was systematically proposed by Hinton et al. in 2015, with the core idea of using the output probability distribution of a large model to guide the training of a small model.74% similarVerifiedKnowledge distillation technology enables small models to extract a considerable proportion of capability from large models, undermining the validity of fixed compute thresholds as a proxy metric for capability.73% similarVerified模型蒸馏（Knowledge Distillation）最初由 Hinton 等人于2015年提出，核心思想是让小模型学习大模型的软标签而非硬标签71% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/489368API
curl https://kongchang.com/api/v1/knowledge/claims/489368MCP
get_claim(id=489368)