Unverified50% confidenceBenchmarkExact time
LangWatch's LLM-as-judge benchmark results show: OpenAI Decisions at 75.2% accuracy, 243 ms median latency, and $1.09 per 1,000 calls; TypeSafe Jev at 63.7% accuracy, 429 ms median latency, and $0.42 per 1,000 calls.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/12/2026
First Seen
Valid until: 1/10/2027
Sources
Related Entities
Related Claims
UnverifiedIn a model comparison test, qwen2.5:3b correctly understood pace, produced 0 hallucinated place names, had a length error of 0.3%, peak memory of 259 MB, and took 106 seconds.65% similarUnverifiedIn the Terminal Bench 4.0 highest-accuracy test, Fable 5.1 achieved an accuracy of 55.8% at a cost of $19.50, while Astra achieved an accuracy of 56.7% at a cost of $10.35.62% similarUnverifiedPerplexity Decider V1.1 27B topped the evaluation with a score of 80/82, a median latency of 0.445 seconds, and zero flips across 26 reversal tests.61% similarUnverifiedArtificial Analysis noted that Haiku 5.5 used 162,000 output tokens in the intelligence index test in Max mode, approximately three times that of GPT-6 Luna.61% similarUnverifiedIn actual testing, the Top Speed configuration completed the run in 14 minutes consuming 2 million tokens; the Kimi K3 model in the Open Weights configuration failed entirely and could not output correct JSON; and the planning phase of Opus 5 in the Frontier configuration ran for 13 minutes.60% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1002804API
curl https://kongchang.com/api/v1/knowledge/claims/1002804MCP
get_claim(id=1002804)