Unverified50% confidenceBenchmarkExact time
In the specific experimental case, the overlapping-anchor scheme (n=912) showed the model at 55.2% versus the majority class at 51.1%, a net advantage of +4.1pp, about 2.4 standard errors; the non-overlapping-anchor scheme (n=163) showed 59.5% versus 54.0%, a net advantage of +5.5pp, about 1.4 standard errors.
1
Sources
50%
Confidence
Long-term
Relevance
10/13/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedFor the 7B model, accuracy with the solver was 75.31% versus 72.02% for direct calculation, a paired improvement of +3.29 percentage points, with a 95% cluster interval of [-3.49, 10.38] crossing zero, making the advantage non-significant.77% similarUnverifiedRanked by question difficulty, persistence rate was 91.4% on the 60 questions that all models answered correctly, but only 73.5% on the 52 questions that at least one model got wrong, indicating that sycophancy tracks uncertainty.75% similarUnverifiedUnder the condition of n=100 with an even split of positive and negative samples, the 95% confidence interval for 55% accuracy is roughly 45%–65%, which covers the 50% baseline, so the 5 percentage point gap may be random fluctuation.74% similarUnverifiedIn the ScopeBench evaluation, the raw capability of the 8 models ranged from 12.2% to 81.1%, and the scope compliance capability ranged from 34.4% to 86.7%.73% similarUnverifiedTaking each model's best effort tier, the solve rate for 5x5 grids is approximately 85%, dropping to 46% for 10x10, and only 20% remaining for 15x15.72% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1016944API
curl https://kongchang.com/api/v1/knowledge/claims/1016944MCP
get_claim(id=1016944)