ConceptSelf-Supervised Forgetting
Self-Supervised Forgetting
The phenomenon in which a model, when performing online adaptation using only self-generated labels, gradually loses the general capabilities acquired during pretraining.
Timeline (last 90 days)
Nov 9
PC-Dr.DPO introduces a cache-based mechanism to reduce self-supervised forgetting during online adaptation.
Unverified50%
Nov 9
Self-supervised forgetting refers to the gradual loss of general capabilities acquired during pretraining when a model adapts online using only self-generated labels.
Unverified50%