[KongchangAI]
ConceptSelf-Supervised Forgetting

Self-Supervised Forgetting

The phenomenon in which a model, when performing online adaptation using only self-generated labels, gradually loses the general capabilities acquired during pretraining.

Timeline (last 90 days)

Nov 9

PC-Dr.DPO introduces a cache-based mechanism to reduce self-supervised forgetting during online adaptation.

Unverified50%
Nov 9

Self-supervised forgetting refers to the gradual loss of general capabilities acquired during pretraining when a model adapts online using only self-generated labels.

Unverified50%

All Facts (2)

Source Articles