Unverified50% confidenceFactExact time
One study notes that even if the erroneous predictions are more accurate, the audit improvement may not be significant.
1
Sources
50%
Confidence
Long-term
Relevance
11/5/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedRecording negative samples where 'a recommended solution did not apply' is just as important as recording successes; otherwise the model will fall into statistical bias, mistaking high-frequency solutions for high-accuracy ones74% similarVerifiedIn scenarios with extreme class imbalance (such as fraud detection), looking solely at accuracy as an evaluation metric is completely meaningless.74% similarUnverifiedResearch shows that in certain tasks, simply changing '请判断' to '请分析' in a prompt can cause accuracy fluctuations of 5–10 percentage points.73% similarUnverified泰特洛克的研究得出结论：专家预测的准确率仅略高于随机猜测，甚至不如简单的统计基准线73% similarUnverifiedScoring with completion-style proxy metrics will classify failures that terminate cleanly but produce incorrect results as successes, which is a flaw in many current agent evaluations.72% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1137687API
curl https://kongchang.com/api/v1/knowledge/claims/1137687MCP
get_claim(id=1137687)