Unverified50% confidenceFactExact time
The evaluation constructed test items targeting 7 common validity flaws in machine learning research, including treating synthetic data as real evidence, test-set leakage, over-generalization from small samples, reporting accuracy under class imbalance, degenerate confidence intervals, uncorrected multiple comparisons, and best-of-N seed selection.
1
Sources
50%
Confidence
Long-term
Relevance
10/12/2026
First Seen
Sources
Related Entities
Related Claims
VerifiedMutation Testing checks whether test cases are truly effective by deliberately introducing defects into the code.73% similarUnverified标注歧义性对应机器学习中的贝叶斯最优误差率概念，可通过让多名标注者独立标注并计算标注者间Dice系数来估算性能天花板73% similarUnverifiedThe standard for checking whether a fine-tuning comparison study contains bias is to examine the hyperparameter search section and confirm that each control group has an independent learning rate tuning record and a sufficient number of random seed repetitions.72% similarUnverifiedThe experiments were tested across six heterogeneous benchmarks.70% similarUnverified多种子实验中检验对象从单样本预测分歧变为多次运行的准确率序列时，通常已不再适用McNemar检验70% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1003790API
curl https://kongchang.com/api/v1/knowledge/claims/1003790MCP
get_claim(id=1003790)