Unverified50% confidenceFactExact time
The most consistent evaluator's agreement rate with the true answers is only 51%, meaning it is "consistently wrong."
1
Sources
50%
Confidence
Long-term
Relevance
10/15/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedFor an invoice classification model with 97% accuracy, when a reviewer examines 300 invoices per day, only about 9 will be wrong, and errors are buried among correct items, causing the reviewer's rejection rate to approach zero.76% similarUnverifiedA gating accuracy of 58% reported in the paper was mistakenly treated as end-to-end quality, whereas the true end-to-end quality is 98%.75% similarUnverifiedIn university-level proof grading, even with the experts' grading rubric in hand, 5 of 7 evaluators still passed 38.0% to 45.7% of proofs that experts judged as failures, while falsely failing only 5.0% to 12.3% of correct proofs.75% similarUnverifiedIn manually proofread samples, the character error rate was only 0.68% when the text was clearly legible, but approximately 45% of sampled passages were completely uncorrectable due to source quality issues.73% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1034834API
curl https://kongchang.com/api/v1/knowledge/claims/1034834MCP
get_claim(id=1034834)