Unverified50% confidenceFactExact time
Generating training data with a teacher model silently transfers the teacher's blind spots, stylistic habits and failure modes, and the student model inherits the specific shape of the teacher's mistakes.
1
Sources
50%
Confidence
Long-term
Relevance
10/17/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedA student model distilled from a given teacher model may inherit the teacher's safety stance, whether or not the developers are explicitly aware of it.76% similarUnverifiedIn knowledge distillation, off-policy distillation uses trajectories generated by the teacher model as training samples, and suffers from the distribution shift problem where the state distribution visited by the teacher is inconsistent with the student's own state distribution.75% similarUnverifiedKnowledge distillation causes student models to inherit certain behavioral patterns of teacher models, resulting in false positives from fingerprint cross-contamination during attribution analysis.74% similarVerifiedThis experiment adopts trajectory-level distillation, which belongs to the category of behavioral cloning, directly having the student model imitate the external behavioral sequences of the teacher model.73% similarUnverifiedModels unconsciously inherit the values, biases, and expression habits present in their training data.72% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1053598API
curl https://kongchang.com/api/v1/knowledge/claims/1053598MCP
get_claim(id=1053598)