ConceptRetention
Retention
A core metric for evaluating language model state updates, measuring whether a model, after completing updates to target fields, can refrain from modifying or forgetting fields that the conversation does not require to be changed. Unlike accuracy, retention focuses on whether the model 'does not do wrong' what it should not do.