Precision
An evaluation metric for classification models that measures the proportion of samples the model labeled as positive that are truly positive. In financial risk control it corresponds to the false positive rate.
Core Facts
The F1 score is the harmonic mean of recall and precision.
In RAG evaluation, recall measures whether relevant documents are fully retrieved, precision measures whether the retrieved documents are truly relevant, and faithfulness measures whether the answer is grounded in the retrieved documents.
A classic trade-off between "recall" and "precision" exists in AI information retrieval: AI Agents tend toward a high-recall strategy (collecting as many sources as possible), while precision control requires human expert judgment as a backstop.
Timeline (last 90 days)
In multi-class tasks, accuracy becomes distorted when class samples are imbalanced; precision reflects the degree of false positives, recall reflects the degree of false negatives, and the F1 score is the harmonic mean of precision and recall.
Context relevance is related to but not identical to recall and precision in the information retrieval field: recall measures whether the documents needed for the answer were retrieved, precision measures how many of the retrieved documents are relevant, while context relevance is closer to an overall judgment of whether the retrieval results as a whole are sufficient to answer the user's question.
In patent search scenarios, the cost of missed detection (low recall) is often higher than that of false detection (low precision), so researchers usually focus more on recall while controlling precision through ranking optimization.
Recall@k and MRR are commonly used to evaluate retrieval quality, while evaluating generation typically looks at the consistency between answers and sources, i.e., faithfulness.
In entity resolution, a shortcut that raised the match rate by ten percentage points had only 38% accuracy against independent identifiers, so it was never released.
精确率衡量模型标记为可疑的交易中真正属于欺诈的比例,召回率衡量所有真实欺诈交易中被模型成功捕获的比例,两者通常存在权衡关系。
The evaluation suite is itself a model with precision and recall relative to human judgment, and both should be tracked.
Precision refers to the proportion of samples the model identifies as positive that are truly positive; recall refers to the proportion of all true positives that the model successfully identifies; the two typically have an inverse relationship.
The F1 score is the harmonic mean of precision and recall; when the two are weighted differently, the Fβ score can be used to reflect priorities.
In RAG evaluation, recall measures whether relevant documents are fully retrieved, precision measures whether the retrieved documents are truly relevant, and faithfulness measures whether the answer is grounded in the retrieved documents.
11 more timeline events
All Facts (20)
The F1 score is the harmonic mean of recall and precision.
75%VerifiedIn RAG evaluation, recall measures whether relevant documents are fully retrieved, precision measures whether the retrieved documents are truly relevant, and faithfulness measures whether the answer is grounded in the retrieved documents.
65%VerifiedA classic trade-off between "recall" and "precision" exists in AI information retrieval: AI Agents tend toward a high-recall strategy (collecting as many sources as possible), while precision control requires human expert judgment as a backstop.
65%VerifiedThe industry commonly uses the F1 score (the harmonic mean of precision and recall) to comprehensively evaluate terminology recognition performance.
65%UnverifiedPR曲线在样本不平衡场景下更有价值,根本原因在于精确率的计算不涉及真负例(TN)的数量
90%UnverifiedIn multi-class tasks, accuracy becomes distorted when class samples are imbalanced; precision reflects the degree of false positives, recall reflects the degree of false negatives, and the F1 score is the harmonic mean of precision and recall.
50%UnverifiedContext relevance is related to but not identical to recall and precision in the information retrieval field: recall measures whether the documents needed for the answer were retrieved, precision measures how many of the retrieved documents are relevant, while context relevance is closer to an overall judgment of whether the retrieval results as a whole are sufficient to answer the user's question.
50%UnverifiedIn patent search scenarios, the cost of missed detection (low recall) is often higher than that of false detection (low precision), so researchers usually focus more on recall while controlling precision through ranking optimization.
50%UnverifiedRecall@k and MRR are commonly used to evaluate retrieval quality, while evaluating generation typically looks at the consistency between answers and sources, i.e., faithfulness.
50%UnverifiedIn entity resolution, a shortcut that raised the match rate by ten percentage points had only 38% accuracy against independent identifiers, so it was never released.
50%Unverified精确率衡量模型标记为可疑的交易中真正属于欺诈的比例,召回率衡量所有真实欺诈交易中被模型成功捕获的比例,两者通常存在权衡关系。
50%UnverifiedThe evaluation suite is itself a model with precision and recall relative to human judgment, and both should be tracked.
50%UnverifiedPrecision refers to the proportion of samples the model identifies as positive that are truly positive; recall refers to the proportion of all true positives that the model successfully identifies; the two typically have an inverse relationship.
50%UnverifiedThe F1 score is the harmonic mean of precision and recall; when the two are weighted differently, the Fβ score can be used to reflect priorities.
50%UnverifiedIn security scenarios, there is a natural tension between precision and recall, and pursuing high recall often comes at the cost of sacrificing precision
50%UnverifiedIn asymmetric-risk scenarios such as medical triage, recall is far more important than precision.
50%UnverifiedAnti-fraud systems prioritize precision to reduce false positives, while disease screening systems prioritize recall
50%UnverifiedIn information retrieval, increasing recall tends to decrease precision, and vice versa.
50%UnverifiedIn the field of information retrieval, recall refers to the proportion of all relevant information that the system finds, while precision refers to the proportion of the information returned by the system that is truly relevant.
50%UnverifiedThere is generally a trade-off relationship between recall and precision.
50%