Unverified50% confidencePredictionExact time
A student model distilled from a given teacher model may inherit the teacher's safety stance, whether or not the developers are explicitly aware of it.
1
Sources
50%
Confidence
Long-term
Relevance
10/14/2026
First Seen
Sources
Related Entities
Related Claims
Unverified通过蒸馏获得的学生模型往往只继承教师模型的能力，而无法复制其经过RLHF等方法植入的安全对齐机制75% similarVerified模型蒸馏是一种将大型教师模型能力迁移到更小学生模型的技术，可能被用于扩散危险能力74% similarUnverifiedTeacher forcing introduces the exposure bias problem: during training the real target token is fed as input, while during inference the model's own predicted token is used, and prediction errors accumulate and amplify in subsequent steps.72% similarUnverifiedThe challenge of streaming model distillation lies in the fact that if the teacher model adopts a non-causal architecture, its latent representations contain future information that the student model cannot access during inference, requiring the design of alignment strategies to prevent the student from being forced to fit information it cannot reproduce.72% similarVerifiedThis experiment adopts trajectory-level distillation, which belongs to the category of behavioral cloning, directly having the student model imitate the external behavioral sequences of the teacher model.71% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1023613API
curl https://kongchang.com/api/v1/knowledge/claims/1023613MCP
get_claim(id=1023613)