[KongchangAI]
ConceptCumulative Evaluation

Cumulative Evaluation

A pre-deployment safety verification mechanism that compares a new model's performance on a cumulatively accumulated evaluation set (including both old and new tasks). A checkpoint switch is permitted only when the new model is no worse than the old one and shows improvement on new requirements, thereby preventing catastrophic forgetting.

Timeline (last 90 days)

Nov 16

G-CAST adopts governed checkpoint switching based on cumulative evaluation, where each model update must pass cumulative evaluation before going live.

Unverified50%

All Facts (1)

Source Articles