Unverified50% confidenceBenchmarkExact time
On the conflict-free tasks across the eight benchmarks, the average utility change brought by the IH improvement was negligible.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/27/2026
First Seen
Valid until: 1/25/2027
Sources
Related Entities
Related Claims
UnverifiedIn a test covering 8 local models and more than 5000 calls, the wording style of the prompt (plain/normal/florid) had almost no effect on accuracy on non-math tasks, with differences of no more than 4 percentage points for models of 8B and above.68% similarUnverifiedIn the first round of experiments, features with verified capabilities averaged 1.43, while features without verified capabilities averaged 1.14, a negligible gap; after fixing the language issues, the same comparison became 2.00 versus 1.07.68% similarUnverifiedThe 7 models that passed the surrogate test had a change rate of 15.9%, while the 6 models that did not pass had a rate as high as 25.8%, indicating that better-performing models are less susceptible to interference but still more so than the effect of prompt modification.67% similarUnverifiedA high score on any single benchmark test (such as 99.9%) only shows that the model performs excellently within the distribution of that test's questions, and cannot be directly equated with general intelligence.66% similarUnverifiedSetting an absolute failure count ceiling for small-sample slices is more robust than setting a percentage threshold and is insensitive to sample size66% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1102032API
curl https://kongchang.com/api/v1/knowledge/claims/1102032MCP
get_claim(id=1102032)