Unverified50% confidenceBenchmarkExact time
Tev1 and the locally run Qwen3.5 9B showed no statistically significant difference in mean field accuracy (0.917 vs 0.918, p = 0.26).
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
11/17/2026
First Seen
Valid until: 2/15/2027
Sources
Related Entities
Related Claims
UnverifiedOn accuracy: τ=0.4 is 0.7305, the hosted single run is 0.7085, the local single run is 0.7320, and τ=0.6 is 0.7115.75% similarUnverifiedThe original Qwen3.5-0.8B has NLL of 2.905585 and PPL of 18.2759; Qwengram-0.8B has NLL of 2.853786 and PPL of 17.3534.73% similarUnverifiedQwen2.5-1.5B scores 0.729 on GSM8K, 18.2 percentage points lower than Gemma 4 E2B; Qwen3-0.6B scores 0.599, 31.2 percentage points lower; SmolLM2-1.7B scores 0.461, 45.0 percentage points lower.71% similarUnverifiedOn the BFCL tool-calling test, SmolLM3-3B scores 0.945, slightly above Gemma 4 E2B's 0.927, but the difference is not significant; Qwen3-4B (0.940), Qwen3-1.7B (0.935), Qwen2.5-1.5B (0.910), and Granite 3.3 2B (0.920) are all at the same level as Gemma.70% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1178545API
curl https://kongchang.com/api/v1/knowledge/claims/1178545MCP
get_claim(id=1178545)