Unverified50% confidenceBenchmarkExact time
On the self-reported Cloudflare internal Decision Index 0.2.1 benchmark, clef-omni leads Jev by a wide margin on intent classification and routing tasks (BANKING77, CLINC150); but on tasks requiring multi-step reasoning (GPQA, BBH, MMLU-Pro), Jev leads by 12 to 31 points.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/12/2026
First Seen
Valid until: 1/10/2027
Sources
Related Entities
Related Claims
UnverifiedJev ranked at the top in the majority of benchmark test items and achieved leading results simultaneously across all three dimensions of accuracy, cost, and latency66% similarUnverifiedpplx-decider-v1-27b achieved an average score of 85.7% across 11 benchmarks, outperforming the comparison target Jev (official data).64% similarUnverifiedThe intelligent routing solution passes 9/12 (75%) tasks and Opus passes 11/12 (92%); of the three failures, two unit test tasks and one QA task were routed to Claude Haiku 5.5, whose responses exceeded the 8,000-token limit.64% similarUnverifiedThe hair shaft counting task is handled by EfficientNet-B5 with a support-map channel, achieving a counting accuracy of 87.0% aligned with expert bounding boxes and a macro-averaged F1 score of 0.85.63% similarUnverifiedIn Microsoft's internal evaluation covering 36 benchmarks and nearly 150,000 questions, Decision-1 ranked first with an average accuracy of 83.5%, surpassing Jev 1.13.0 (82.3%), Quyet-1.0-Large (81.9%), and GPT-6 Luna Decisions (79.4%).63% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1011204API
curl https://kongchang.com/api/v1/knowledge/claims/1011204MCP
get_claim(id=1011204)