Faithfulness
A RAG evaluation concept that measures whether a generated answer is based solely on the retrieved context. It is an internal consistency check and does not verify the truthfulness of the context itself.
Timeline (last 90 days)
The goal of Autoformalization (AF) is to translate natural language mathematical propositions into formal statements; compiling successfully does not mean the translation is correct, and the formal statement must preserve the semantics of the informal source, a property known as faithfulness.
In the field of explainable AI, faithfulness measures whether an explanation truly reflects the model's internal computation process, while plausibility measures whether the explanation appears reasonable to humans.
All Facts (2)
The goal of Autoformalization (AF) is to translate natural language mathematical propositions into formal statements; compiling successfully does not mean the translation is correct, and the formal statement must preserve the semantics of the informal source, a property known as faithfulness.
50%UnverifiedIn the field of explainable AI, faithfulness measures whether an explanation truly reflects the model's internal computation process, while plausibility measures whether the explanation appears reasonable to humans.
50%