Unverified50% confidenceFactExact time
Benchmark saturation refers to a situation where the questions or solutions in a test set have been covered by a model's training data, causing high scores to no longer represent true capability.
1
Sources
50%
Confidence
Long-term
Relevance
10/4/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedBenchmark gaming is widespread, as models may be exposed to test-set-related data during training or fine-tuning, resulting in inflated scores but insufficient generalization ability.78% similarVerifiedOverfitting refers to the phenomenon where a model performs excellently on training data but its performance drops significantly on unseen test data.78% similarVerifiedBenchmark data contamination refers to the phenomenon where, after a test set is made public, its questions may appear in the pre-training corpora of subsequent models, causing scores to reflect memorization rather than genuine reasoning ability.77% similarUnverifiedPerforming StandardScaler normalization on the entire dataset before the train/test split causes the mean and variance information of the test set to leak into the training set, constituting data leakage.76% similarVerified若用含测试集的全量数据计算均值和标准差，会导致预处理泄漏，使评估指标虚高，无法真实反映模型泛化能力76% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/973509API
curl https://kongchang.com/api/v1/knowledge/claims/973509MCP
get_claim(id=973509)