Verified65% confidenceFactExact time
模型蒸馏（Knowledge Distillation）最初由 Hinton 等人于2015年提出，核心思想是让小模型学习大模型的软标签而非硬标签
3
Sources
65%
Confidence
Long-term
Relevance
7/12/2026
First Seen
Sources
Alibaba Bans Claude Code: Invisible Fingerprints and the AI Tool Trust Crisis
bilibili链捕手ChainCatcher7/4/2026
Related Claims
VerifiedKnowledge distillation was proposed by Hinton et al. in 2015, originally referring to training a small model using the soft label outputs of a large model.84% similarUnverifiedModel distillation technology was proposed by Geoffrey Hinton's team in 2015, originally used for model compression, by having a student model fit the soft-label outputs of a teacher model.78% similarUnverifiedThe core idea of knowledge distillation is to have the small model learn the probability distribution (soft labels) of the large model's outputs rather than just hard labels78% similarUnverifiedKnowledge distillation was systematically proposed by Hinton et al. in 2015, with the core idea of using the output probability distribution of a large model to guide the training of a small model.77% similarUnverifiedKnowledge Distillation is a technique for transferring the knowledge of a large model to a smaller, lightweight model, capable of retaining most of the performance while reducing the parameter count by tens of times.76% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/488977API
curl https://kongchang.com/api/v1/knowledge/claims/488977MCP
get_claim(id=488977)