Energy-Guided Distillation

A distillation method for discrete flow matching that introduces an energy function to evaluate sequence quality and guide training trajectories, enabling a student model to generate high-quality text in fewer steps. The core idea is to optimize the quality of teacher trajectories rather than expanding student model capacity.