Traditional knowledge distillation typically uses soft labels output by the teacher model to transfer dark knowledge such as inter-class similarities.