[KongchangAI]
ConceptPrivileged Information Distillation / LUPI

Privileged Information Distillation

A knowledge distillation paradigm derived from the learning-using-privileged-information framework, in which the teacher can access additional features such as bounding boxes or depth maps during training while the student relies only on regular inputs at deployment. It can improve sample efficiency but depends on assumptions about the relevance of privileged information to the task.

Source Articles