Unverified50% confidenceFactExact time
Paired testing focuses only on discordant pairs, so even when two runs have the same average score, it can still detect a statistically significant regression.
1
Sources
50%
Confidence
Long-term
Relevance
10/19/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedThe study recommends that benchmarks should be run multiple times and report variance intervals, explicitly marking which comparative conclusions are statistically inconclusive76% similarUnverifiedThe paper's authors note that the concentrated diagonal data provides only a consistency check beyond the fitting, rather than a fully independent held-out test.74% similarUnverifiedMost benchmarks use accuracy as the core metric, counting both wrong answers and refusals as incorrect and not distinguishing the difference in harm.72% similarUnverifiedWilcoxon检验是一种非参数统计方法,适合在样本量有限、不满足正态分布假设的情况下检验两组结果差异的统计显著性71% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1066525API
curl https://kongchang.com/api/v1/knowledge/claims/1066525MCP
get_claim(id=1066525)