[KongchangAI]
ConceptRobustness / 鲁棒性与自我修正

Robustness

The ability of an AI system to maintain stable outputs when confronted with input perturbations, intermediate-step errors, or environmental changes, including the capacity to detect contradictions and perform self-correction. Robustness serves as an important metric for evaluating the reliability of large language models.

Timeline (last 90 days)

Oct 13

Multi-value alignment objectives need to assess the similarity and conflict between values as a prior indicator of robustness.

Unverified50%
Oct 11

An engineeringly reliable embedding model should exhibit minimal vector change under character-level and lexical-level perturbations, highly similar vectors under semantic-level paraphrasing, and a perceptible distance change when there is a substantive semantic shift (such as negation).

Unverified50%
Oct 9

The error recovery capability corresponds to the concepts of Robustness and Self-correction in AI system evaluation.

Unverified50%
Oct 1

Robustness does not require a function to be completely consistent every time, but does require it to be sufficiently intelligent every time (a lower bound on intelligent decision quality).

Unverified50%

All Facts (5)

Source Articles