McNemar's Test
A statistical test proposed by psychologist Quinn McNemar in 1947 for paired nominal data. It is particularly suited for comparing the performance of two classifiers on the same test set, assessing the significance of differences by analyzing samples on which the two models disagree.
Timeline (last 90 days)
AUC is a metric measuring the ranking ability of a binary classification model, ranging from 0.5 to 1, and does not depend on a specific threshold; the McNemar test is a statistical test for paired binary classification data, with p<0.05 generally considered significant.
All Facts (4)
该项目采用配对McNemar检验作为统计显著性验证方法
90%UnverifiedMcNemar's test is a non-parametric test method specifically designed for paired binary classification data
60%UnverifiedAUC is a metric measuring the ranking ability of a binary classification model, ranging from 0.5 to 1, and does not depend on a specific threshold; the McNemar test is a statistical test for paired binary classification data, with p<0.05 generally considered significant.
50%UnverifiedMcNemar 检验要求两个模型在完全相同的测试集上评估，任何测试集的不一致都会使检验失效
50%