Context Relevance
One of the RAG evaluation metrics. It measures how well the document chunks returned by retrieval match the user query, reflecting retrieval quality.
Timeline (last 90 days)
An answer can be entirely faithful to a wrong source document (faithful but wrong), so faithfulness must be paired with context relevance and answer relevance rather than used as a single headline KPI.
Evaluating a RAG system requires measuring two stages separately: context relevance checks the retrieval step (whether the retrieved documents truly contain the answer), and faithfulness checks the generation step (whether the generated answer comes strictly from the retrieved context rather than introducing external information).
Context relevance is related to but not identical to recall and precision in the information retrieval field: recall measures whether the documents needed for the answer were retrieved, precision measures how many of the retrieved documents are relevant, while context relevance is closer to an overall judgment of whether the retrieval results as a whole are sufficient to answer the user's question.
All Facts (3)
An answer can be entirely faithful to a wrong source document (faithful but wrong), so faithfulness must be paired with context relevance and answer relevance rather than used as a single headline KPI.
50%UnverifiedEvaluating a RAG system requires measuring two stages separately: context relevance checks the retrieval step (whether the retrieved documents truly contain the answer), and faithfulness checks the generation step (whether the generated answer comes strictly from the retrieved context rather than introducing external information).
50%UnverifiedContext relevance is related to but not identical to recall and precision in the information retrieval field: recall measures whether the documents needed for the answer were retrieved, precision measures how many of the retrieved documents are relevant, while context relevance is closer to an overall judgment of whether the retrieval results as a whole are sufficient to answer the user's question.
50%