Reasoning Distillation
A branch of knowledge distillation in which the reasoning processes generated by a large teacher model, rather than only its final answers, are used to train a smaller student model so that it acquires step-by-step reasoning ability.
Timeline (last 90 days)
Traditional reasoning distillation provides the teacher model's complete reasoning trace together with the correct answer to the student model, but a reasoning trace, even when accompanied by the correct answer, does not necessarily provide effective supervision signals for a particular student.
Reasoning distillation is a branch of knowledge distillation, referring to using reasoning processes generated by a large teacher model (rather than only the final answer) to train a smaller student model so that it acquires step-by-step reasoning ability.
All Facts (2)
Traditional reasoning distillation provides the teacher model's complete reasoning trace together with the correct answer to the student model, but a reasoning trace, even when accompanied by the correct answer, does not necessarily provide effective supervision signals for a particular student.
50%UnverifiedReasoning distillation is a branch of knowledge distillation, referring to using reasoning processes generated by a large teacher model (rather than only the final answer) to train a smaller student model so that it acquires step-by-step reasoning ability.
50%