Distribution Mismatch
In teacher-student frameworks, the problem that the teacher's and student's reasoning distributions are inconsistent; this accumulates with sequence length and adds noise to the supervision signal.
Timeline (last 90 days)
The longer the prefix, the more severe the mismatch between the student-generated prefix and the distribution familiar to the teacher.
Although task-level RLVR improves the teacher's independent problem-solving ability, it does not resolve the distribution mismatch between teacher and student.
All Facts (2)
The longer the prefix, the more severe the mismatch between the student-generated prefix and the distribution familiar to the teacher.
50%UnverifiedAlthough task-level RLVR improves the teacher's independent problem-solving ability, it does not resolve the distribution mismatch between teacher and student.
50%