#off-policy vs on-policy

On-Policy Distillation Explained: Principles, Advantages, and Applications — A Comprehensive Guide

A deep dive into On-Policy Distillation: core principles, key differences from Off-Policy methods, and applications in model compression, reasoning transfer, RLHF alignment, and self-improvement.