Unverified50% confidenceFactExact time
The exact McNemar test compares binary outcomes of two related samples using only the discordant pairs (the number of gains b and the number of losses c); under the null hypothesis b and c follow a binomial distribution with success probability 0.5, and the exact version directly computes binomial tail probabilities rather than the large-sample chi-square approximation, still giving reliable p-values when b+c is small.
1
Sources
50%
Confidence
Long-term
Relevance
10/19/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedMcNemar 检验关注两个模型在每个样本上的分歧情况，只有判断结果不一致的样本（b和c单元格）具有信息量，两者都对或都错的样本被视为无关信息80% similarUnverifiedMcNemar 检验统计量为 χ² = (|b - c| - 1)² / (b + c)，当样本量足够时近似服从自由度为1的卡方分布，其中-1为Yates连续性校正项77% similarUnverified对同一测试用例执行多次调用统计成功比例得到通过率，比二元的通过/失败判断更能反映模型真实表现76% similarUnverifiedMcNemar检验的零假设是b和c在总体中相等，即两个模型犯错方向对称，无系统性优劣76% similarUnverifiedPaired statistics (n=107) show 99 agreements, 2 cases where Swift was better, and 6 cases where it was worse; McNemar's exact test yielded p≈0.29, making the quality of the two statistically indistinguishable.73% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1066537API
curl https://kongchang.com/api/v1/knowledge/claims/1066537MCP
get_claim(id=1066537)