Unverified50% confidenceFactExact time
Performing StandardScaler normalization on the entire dataset before the train/test split causes the mean and variance information of the test set to leak into the training set.
1
Sources
50%
Confidence
Long-term
Relevance
8/26/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedMultiple studies in 2024 found that the strong performance of certain models on standard benchmarks resulted from benchmark test questions being mixed into the training data (data contamination).74% similarUnverified参数量相似的情况下，训练数据质量分布的差异往往比架构差异更能决定特定场景的表现上限74% similarVerifiedBenchmarks face contamination risks; if training data contains test questions or approximate variants, a model's high scores may partly stem from memorization rather than genuine capability.72% similarUnverifiedThe train-serve consistency problem refers to logical discrepancies between offline feature computation during training and online real-time feature computation during serving, which can cause the model's online performance to be severely worse than its offline evaluation.71% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/806499API
curl https://kongchang.com/api/v1/knowledge/claims/806499MCP
get_claim(id=806499)