Unverified50% confidenceBenchmarkExact time
In a 14-question test for fixing real bugs, DevStral and Qwen3 each fixed 12, with an average of no more than 97 seconds per question.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/3/2026
First Seen
Valid until: 1/1/2027
Sources
Related Entities
Related Claims
UnverifiedA user with a private benchmark stated that Qwen 3.8 was only the second local model able to correctly reason through their test questions, but it took 12 minutes and 30 seconds and used five times as many tokens as Gemma 4.69% similarUnverifiedQwen3 27B achieved a 100% pass rate in the 256K long-context memory retrieval test (needle in a haystack), with all 15 runs being accurate.69% similarUnverifiedQwen 3.6 Max in neutral mode has an ambiguity detection F1 of only 16% and asks an average of only 0.07 questions per task, but once it does ask for clarification, the accuracy reaches 94.7%66% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/970921API
curl https://kongchang.com/api/v1/knowledge/claims/970921MCP
get_claim(id=970921)