Unverified50% confidenceFactExact time
Strict macro exact match requires the predicted answer to be exactly identical to the reference answer after normalization, computing accuracy separately on each subtask and then averaging, so that small hard subsets and easy subsets receive equal weight.
1
Sources
50%
Confidence
Long-term
Relevance
11/19/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedResult validation requires establishing objective quantitative standards—such as classification accuracy, reply compliance, and manual correction ratio—and calculating statistics over a sufficient sample size.79% similarUnverifiedExact Match (EM) is a strict evaluation metric in question-answering tasks that requires the model's output to be completely identical to the reference answer.78% similarUnverifiedExact-match accuracy requires that the entire grid output by the model match the reference grid cell by cell, and even a single wrong cell is counted as a failure.78% similarUnverifiedA benchmarking mechanism should be established that uses standard questions with known answers to continuously verify the accuracy of Agent outputs.78% similarUnverifiedThe paired statistical test uses clustered confidence intervals to correct for within-calculator sample correlations, making it more rigorous than directly comparing overall accuracy rates.78% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1186623API
curl https://kongchang.com/api/v1/knowledge/claims/1186623MCP
get_claim(id=1186623)