Unverified50% confidenceBenchmarkExact time
On JudgeBench, Decider made 620 judgments and publicly disclosed 6 first-round failures.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/12/2026
First Seen
Valid until: 1/10/2027
Sources
Related Entities
Related Claims
UnverifiedDecider reports a correct rate of 99.6% for judgments at 90% confidence and above on JudgeBench, 94.0% for the 80–90 interval, 84.1% for the 70–80 interval, and 67.7% for below 70%.63% similarUnverifiedThe ThinkingBox benchmark conducted a total of 121,680 trials, of which 79,853 failed.59% similarUnverifiedThe LLM judge serving as evaluator assigns almost all outputs a score of 7 or 8, causing it to lose discriminative power.56% similarUnverifiedThe researchers confirmed 91 failures through manual verification and categorized them into 7 failure loci.55% similarUnverifiedJCE所谓的'可靠'实际只有约60%的准确率，因误差累积连续5步后整体成功率仅剩约7.8%54% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1001726API
curl https://kongchang.com/api/v1/knowledge/claims/1001726MCP
get_claim(id=1001726)