Unverified50% confidenceBenchmarkExact time
In a comparison on 40 large-number multiplication problems, the original Qwen 3.5 got 22 right, the version equipped with QNPUTER got 39 right, and the one connected to real Python got 40 right; the results returned by QNPUTER were all correct, and the errors originated in Qwen itself, such as dropping signs when copying answers or calling 44 times repeatedly without finishing.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/31/2026
First Seen
Valid until: 1/29/2027
Sources
Related Entities
Related Claims
UnverifiedOn the 35 prompts that the router kept local, Llama 3.2 1B's answers were judged acceptable 30 times (86%, average 4.4/5); on the 23 text prompts sent to the cloud, the same model was acceptable only 4 times (17%, average 2.0/5).69% similarUnverifiedOn 13 questions, the graph approach (Ratified) answered 13/13 correctly; a BM25 plus bge-small retriever on the same text hit exactly 1/10, placed within the top ten 3/10, and three counting questions could not be scored.68% similarUnverifiedIn the hard-to-verify category with injection bait, the number of questions for which GPT-5.4 mini judged incorrectly in both orderings rose from 3 to 39, Qwen3-Next 80B Instruct from 4 to 38, and GPT-5.4 mini and Qwen3-Next Instruct scored zero on hard questions (below the approximately 0.25 expected from random coin flipping).67% similarUnverifiedIn the first round of tests (23 synthetic cases × 3 runs), qwen2.5:1.5b achieved only a 30% correct-judgment rate and qwen2.5:7b only 46%, both failing; qwen2.5:7b incorrectly judged "covered" in 14% of cases.67% similarUnverifiedClaude Haiku 4.5 answered 'not found' in 21 of its 24 errors on two-step questions, while GPT-5.4 mini copied the literal wording of the referral as the answer in 20 of its 27 errors, and fabricated real-sounding names while citing actual documents in another 7.67% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1121153API
curl https://kongchang.com/api/v1/knowledge/claims/1121153MCP
get_claim(id=1121153)