Unverified60% confidenceFactExact time
The theoretical basis of knowledge distillation comes from the groundbreaking work of Hinton et al. in 2015, which transfers dark knowledge contained in soft labels to smaller models.
2
Sources
60%
Confidence
Long-term
Relevance
7/18/2026
First Seen
Sources
Related Claims
UnverifiedModel distillation technology was first proposed by Geoffrey Hinton and others in 2015, originally intended to address the difficulty of deploying deep neural networks on edge devices61% similarUnverifiedRAG (Retrieval-Augmented Generation) was first proposed by a Meta research team in 2020; its core idea is to introduce external knowledge retrieval before large model inference to mitigate hallucination issues.59% similarUnverified对抗性样本（Adversarial Examples）的理论基础由Szegedy等人于2013年首次系统阐述59% similarUnverifiedPhilosopher Michael Polanyi called the ability to make judgments that cannot be verbalized "tacit knowledge".59% similarUnverifiedFirst principles thinking is a method of reasoning originating from Aristotelian philosophy that became widely known in the tech world in recent years due to Elon Musk's advocacy; it emphasizes breaking a problem down to its most fundamental facts and axioms and then deriving solutions from scratch.58% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/550641API
curl https://kongchang.com/api/v1/knowledge/claims/550641MCP
get_claim(id=550641)