ConceptAnswer Loss
Answer Loss
A loss function that directly supervises the correctness of the final answers generated by the student model, typically cross-entropy over answer tokens.
Timeline (last 90 days)
Oct 19
Optimizing only the trace loss may cause the student to overfit to the surface form of the reasoning text while ignoring the correctness of the conclusion; optimizing only the answer loss degenerates into traditional answer distillation and loses the transfer of reasoning ability.
Unverified50%