Unverified50% confidenceBenchmarkExact time
The five systems achieved standard answer accuracy ranging from 0.969 to 0.996.
1
Sources
50%
Confidence
Long-term
Relevance
9/23/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedThe accuracy data in the test has an error margin of approximately ±8–10 percentage points at n=100 sample size (based on a 95% confidence-level binomial confidence interval).67% similarUnverifiedFor the 7B model, accuracy with the solver was 75.31% versus 72.02% for direct calculation, a paired improvement of +3.29 percentage points, with a 95% cluster interval of [-3.49, 10.38] crossing zero, making the advantage non-significant.67% similarUnverifiedWhen extracting structured data such as publication year, model accuracy is as high as 0.9766% similarUnverifiedPew's ATP design effect typically ranges between 1.5 and 2.5, meaning that a survey with a nominal sample size of 1,000 may have an effective sample size of only 400–667.66% similarUnverifiedIn financial statements, character accuracy may be as high as 99%, but semantic accuracy may be less than 50%.65% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/942847API
curl https://kongchang.com/api/v1/knowledge/claims/942847MCP
get_claim(id=942847)