Unverified50% confidenceFactExact time
The confidence interval of the test results for the first group of 200 photos touched zero and did not reach statistical significance; the team therefore built a second independent batch to verify.
1
Sources
50%
Confidence
Long-term
Relevance
10/13/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedDue to sampling variance, each test message should be run twice; a rule that holds with only 50% probability is effectively no rule at all.67% similarUnverifiedOn a small test set of only one hundred scenarios, scores can swing by several percentage points between different runs, and judgment should be made on the full dataset.65% similarUnverifiedDuring testing, cases emerged where a model claimed 95% confidence in a move but scored 0 points according to the evaluation criteria.64% similarUnverified对同一测试用例执行多次调用统计成功比例得到通过率，比二元的通过/失败判断更能反映模型真实表现63% similarUnverifiedThe accuracy data in the test has an error margin of approximately ±8–10 percentage points at n=100 sample size (based on a 95% confidence-level binomial confidence interval).63% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1015551API
curl https://kongchang.com/api/v1/knowledge/claims/1015551MCP
get_claim(id=1015551)