Unverified50% confidenceBenchmarkExact time
Direct use of Kev achieves 64.00% accuracy, and Qwen3.5-4B outputting only the final answer achieves 68.80% accuracy.
1
Sources
50%
Confidence
Short-term (~14 days)
Relevance
10/20/2026
First Seen
Valid until: 11/3/2026
Sources
Related Entities
Related Claims
UnverifiedIn agentgateway's testing, qwen3.8 (27.3B, Q4_K_M quantization, 262K context) had a valid answer rate of 90.0% (54/60), an accuracy rate among answered questions of 98.1% (53/54), and an overall accuracy rate of 88.3% (53/60).79% similarUnverifiedThe Q3_K_M quantized model's accuracy improved from 52% to 66%, representing the largest improvement.74% similarUnverifiedTesting with the Qwen model yielded consistent conclusions, with the token approach achieving 67.0% accuracy versus 64.8% for real data.72% similarUnverifiedOn VL-RewardBench, JEV-27B-VL achieves an overall accuracy of 78.3%, 83.2% on hallucination items, 78.2% on reasoning items, and 58.0% on general questions.71% similarUnverifiedThe simple 3-rule baseline used for comparison achieved an accuracy of only 64.4%, with Jev leading by approximately 8 percentage points.71% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1073919API
curl https://kongchang.com/api/v1/knowledge/claims/1073919MCP
get_claim(id=1073919)