Unverified50% confidenceDecision RuleExact time
If the seller reports 92% accuracy after excluding 30% uncertain cases, both numbers should be written into the claims.
1
Sources
50%
Confidence
Long-term
Relevance
10/20/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedThe 98% score from a single classification is the confidence level for that message's corresponding category, and does not represent an overall model accuracy of 98%.71% similarUnverifiedThe confidence reported by the model is severely disconnected from actual accuracy: the 95% confidence tier had an actual accuracy of 0%, while the 90% and 70% tiers both had an actual accuracy of 100%.71% similarUnverifiedWhen evaluating a judge, one should look at the confusion matrix rather than just accuracy; if 90% of the samples are good answers to begin with, a judge that passes everything can still show 90% accuracy.70% similarUnverifiedIn another evaluation of 330 merchants, the paper scored using deterministic rules with no human raters; only 115 merchants (35%) reached the rankable threshold, and the median score of rankable merchants was between 89 and 90.69% similarUnverifiedFaithfulness checking is done claim by claim, and this claim-by-claim comparison is more precise than overall scoring, because an answer may have 90% of its content verifiable but mixed with 10% fabricated information, and that 10% hallucination is enough to mislead users into making wrong decisions.69% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1075131API
curl https://kongchang.com/api/v1/knowledge/claims/1075131MCP
get_claim(id=1075131)