Continual Pre-training

A large model training method in which an existing pre-trained model continues to be trained on newly added data, enabling the model to update its knowledge and adapt to new scenarios while mitigating catastrophic forgetting.