Unverified50% confidenceFactExact time
When the activation function is ReLU, the target function is a pure spherical harmonic, and under Gaussian universality assumptions, the student's error scales approximately as the square of the teacher's error
1
Sources
50%
Confidence
Long-term
Relevance
10/8/2026
First Seen
Sources
Related Entities
Related Claims
Unverified多对一映射导致教师token间的不确定性在投影到学生第一个token时被直接加和抹平，这是投影方式的固有属性而非实现错误68% similarUnverifiedLogical fallacies in intermediate steps of mathematical derivations are harder for students lacking foundational knowledge to identify than obvious grammatical errors.68% similarUnverified该方法属于模仿学习中的行为克隆，其著名缺陷是复合误差问题62% similarUnverifiedSynthetic data distillation prevents the student model from learning the teacher's confidence distribution, resulting in relatively limited generalization ability on ambiguous samples.61% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/986985API
curl https://kongchang.com/api/v1/knowledge/claims/986985MCP
get_claim(id=986985)