Unverified50% confidenceBenchmarkExact time
In Microsoft's internal evaluation covering 36 benchmarks and nearly 150,000 questions, Decision-1 ranked first with an average accuracy of 83.5%, surpassing Jev 1.13.0 (82.3%), Quyet-1.0-Large (81.9%), and GPT-6 Luna Decisions (79.4%).
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/11/2026
First Seen
Valid until: 1/9/2027
Sources
Related Entities
Related Claims
UnverifiedThe benchmark published by Bespoke Labs covers 33 public datasets and 3,880 manually labeled decisions; Jeff 1.1B achieves the highest average accuracy at 76%, Nimble 9B at 75.7%, Jeff 1.4B at 73.3%, and the 0.8B version at 63.5%.76% similarUnverifiedThe Top3 configuration achieved an accuracy of 97.148%, a weighted F1 of 97.055%, and an MCC of 0.9675, comprehensively outperforming the Full21 configuration using all 21 metrics (accuracy 95.999%, weighted F1 95.521%, MCC 0.9549).72% similarUnverifiedThe V1 approach achieved a self-tested top-1 accuracy of 93%, but scored 0/137 top-5 accuracy on a benchmark set of 137 real photographs.71% similarUnverifiedOn the WebArena browser agent benchmark, the then-strongest GPT-4 agent scored 14.41%, while humans scored 78.24%.70% similarUnverifiedpplx-decider-v1-27b achieved an average score of 85.7% across 11 benchmarks, outperforming the comparison target Jev (official data).70% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/997999API
curl https://kongchang.com/api/v1/knowledge/claims/997999MCP
get_claim(id=997999)