Unverified50% confidenceTradeoffExact time
Although sample splitting guarantees the theoretical properties, it reduces the sample size used to compute the test statistic, which may weaken test power in small-sample settings.
1
Sources
50%
Confidence
Long-term
Relevance
10/15/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedThe comparative experiment did not disclose specific dataset sizes, evaluation metrics, or details of comparison fairness, all of which affect the generalizability of its conclusions.77% similarUnverified用单一测试案例评估模型性能是一个统计陷阱,即小样本偏差(Small Sample Bias)77% similarUnverifiedClustered standard errors target the situation of non-independent samples and can handle correlation between samples, whereas treating each sample as an independent observation underestimates the variance.76% similarUnverifiedThe authors note that this significance may be affected by the small sample size and multiple comparisons, and could be due to chance.76% similarUnverifiedSetting an absolute failure count ceiling for small-sample slices is more robust than setting a percentage threshold and is insensitive to sample size76% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1032921API
curl https://kongchang.com/api/v1/knowledge/claims/1032921MCP
get_claim(id=1032921)