Unverified50% confidenceBenchmarkExact time
Decider's self-tested consistent accuracy on ContextualJudgeBench under the official paired protocol is 67.1%, compared to the official reference value of 65.4%, with 12 orders excluded due to repeated platform failures.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/12/2026
First Seen
Valid until: 1/10/2027
Sources
Related Entities
Related Claims
UnverifiedIn Microsoft's internal evaluation covering 36 benchmarks and nearly 150,000 questions, Decision-1 ranked first with an average accuracy of 83.5%, surpassing Jev 1.13.0 (82.3%), Quyet-1.0-Large (81.9%), and GPT-6 Luna Decisions (79.4%).66% similarUnverifiedCaveman's fixed benchmark test results from 54 runs show a 33.2% reduction in input tokens, with all 18/18 correctness checks passing.62% similarUnverifiedThe benchmark published by Bespoke Labs covers 33 public datasets and 3,880 manually labeled decisions; Jeff 1.1B achieves the highest average accuracy at 76%, Nimble 9B at 75.7%, Jeff 1.4B at 73.3%, and the 0.8B version at 63.5%.62% similarUnverifiedThe Top3 configuration achieved an accuracy of 97.148%, a weighted F1 of 97.055%, and an MCC of 0.9675, comprehensively outperforming the Full21 configuration using all 21 metrics (accuracy 95.999%, weighted F1 95.521%, MCC 0.9549).61% similarUnverifiedThe simple 3-rule baseline used for comparison achieved an accuracy of only 64.4%, with Jev leading by approximately 8 percentage points.60% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1001728API
curl https://kongchang.com/api/v1/knowledge/claims/1001728MCP
get_claim(id=1001728)