Teacher Takeover
In agent training, refers to the teacher model continuing to execute subsequent actions from a certain intermediate state (typically one where the student has deviated substantially) until the end of the episode, reflecting the teacher's long-horizon actual behavior policy.
Timeline (last 90 days)
The researchers found that even starting from the states where the student deviates the most, the teacher's own takeover can still complete the task, whereas the student, after training on the teacher's per-token scores, often runs out of turns.
The R2S pipeline has three steps: 1) starting from the untrained student model, mine the states where it diverges most from the teacher; 2) run teacher takeovers from these states and filter the takeover segments using reward-free checks (consensus or LLM judging); 3) fine-tune the teacher scorer on the filtered takeover data, then freeze it as the sole scorer for standard OPD.
All Facts (2)
The researchers found that even starting from the states where the student deviates the most, the teacher's own takeover can still complete the task, whereas the student, after training on the teacher's per-token scores, often runs out of turns.
50%UnverifiedThe R2S pipeline has three steps: 1) starting from the untrained student model, mine the states where it diverges most from the teacher; 2) run teacher takeovers from these states and filter the takeover segments using reward-free checks (consensus or LLM judging); 3) fine-tune the teacher scorer on the filtered takeover data, then freeze it as the sole scorer for standard OPD.
50%