Unverified50% confidenceBenchmarkExact time
Among the 12 model × task combinations, only gpt-5.4-mini showed a statistically significant accuracy improvement on the logical reasoning task: jumping from 15% to 97.5%, with p=0.00056 after Holm correction.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/12/2026
First Seen
Valid until: 1/10/2027
Sources
Related Entities
Related Claims
UnverifiedFor the 7B model, accuracy with the solver was 75.31% versus 72.02% for direct calculation, a paired improvement of +3.29 percentage points, with a 95% cluster interval of [-3.49, 10.38] crossing zero, making the advantage non-significant.75% similarUnverifiedOn performance model code construction tasks, the average pass rate of all model configurations other than GPT-5.6 Sol was below 15%, with extremely large fluctuations across multiple runs.74% similarUnverified参数量在1亿以下的轻量模型经领域数据微调后可达95%以上意图分类准确率，单次推理延迟控制在5-20ms以内73% similarUnverifiedA WANDR score of 0.610 does not mean the model fully succeeds on 60% of tasks; the actual partial completion rate is related to the distribution of task complexity.72% similarUnverifiedRanked by question difficulty, persistence rate was 91.4% on the 60 questions that all models answered correctly, but only 73.5% on the 52 questions that at least one model got wrong, indicating that sycophancy tracks uncertainty.72% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1007696API
curl https://kongchang.com/api/v1/knowledge/claims/1007696MCP
get_claim(id=1007696)