Unverified50% confidenceDecision RuleExact time
When reporting success rates, the sample size must be included, because 19/20 and 950/1000 represent different levels of evidential strength.
1
Sources
50%
Confidence
Long-term
Relevance
10/11/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedThe accuracy data in the test has an error margin of approximately ±8–10 percentage points at n=100 sample size (based on a 95% confidence-level binomial confidence interval).78% similarUnverifiedA 95% confidence level means that if the same methodology were used to conduct 100 surveys, approximately 95 of them would produce results falling within the margin of error.71% similarUnverifiedWhen the sample size is small (e.g., only 5–10 successful requests), quantile estimation errors can be large; numpy.percentile or a larger sample size can be used to improve reliability.71% similarUnverifiedThe paired 95% confidence interval for the strict score gain from evidence replacement is [8.77, 10.43].71% similarUnverified对同一测试用例执行多次调用统计成功比例得到通过率，比二元的通过/失败判断更能反映模型真实表现71% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/998881API
curl https://kongchang.com/api/v1/knowledge/claims/998881MCP
get_claim(id=998881)