Unverified50% confidenceBenchmarkExact time
In the hard-to-verify category with injection bait, the number of questions for which GPT-5.4 mini judged incorrectly in both orderings rose from 3 to 39, Qwen3-Next 80B Instruct from 4 to 38, and GPT-5.4 mini and Qwen3-Next Instruct scored zero on hard questions (below the approximately 0.25 expected from random coin flipping).
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/11/2026
First Seen
Valid until: 1/9/2027
Sources
Related Entities
Related Claims
UnverifiedIn the hard-to-verify category with no bait, GPT-5.4 nano answered only 19/40 questions correctly in both orderings and had a 65% probability of selecting Response A; GPT-5.4 mini had a 66% probability of selecting A, Grok 4.20 non-reasoning was 62%, while strong judges were stable at 50%.72% similarUnverifiedOn the Artificial Analysis Intelligence Index, Qwen3.8 27b scored 34, Qwen3.6 27b scored 21, Gemma 4 26b scored 17, GLM 4.7 Flash scored 15, and Qwen3 Coder Next scored only 9.71% similarVerifiedQwen3-4B is already on par with DeepSeek V3 or GPT-4o on multiple reasoning evaluation metrics.68% similarUnverifiedIn a test of 30 Three.js One-Shot programming problems, Qwen 3.8 passed 24 and Ornith 1.5 passed 15, both running under Q6 quantization.67% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/996777API
curl https://kongchang.com/api/v1/knowledge/claims/996777MCP
get_claim(id=996777)