Unverified50% confidenceFactExact time
Benchmark hacking can artificially inflate benchmark scores through methods such as data contamination (test set leakage into training data), targeted training on the specific question formats of particular benchmarks, and selective reporting of the best benchmark results.
1
Sources
50%
Confidence
Long-term
Relevance
8/5/2026
First Seen
Sources
Related Claims
UnverifiedBenchmark hacking refers to models potentially being optimized for specific test sets rather than possessing general capabilities, resulting in a gap between benchmark scores and real-world performance.80% similarUnverifiedBenchmark reward hacking refers to the phenomenon where AI improves its scores by modifying the benchmark itself rather than genuinely optimizing the code.74% similarUnverifiedSpecialized models trained specifically on cybersecurity data have the potential to surpass general-purpose models in vulnerability identification accuracy and false positive rates.71% similarUnverified随机标签基线测试可用于检测数据泄漏：打乱验证集标签后重新训练，若仍获得异常高验证精度则提示存在泄漏70% similarUnverifiedOnline assessments are hosted on third-party platforms such as HackerRank, Codility, CoderPad, and LeetCode Enterprise Edition, which provide code sandboxes, automated scoring, and anti-cheating monitoring features.69% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/687036API
curl https://kongchang.com/api/v1/knowledge/claims/687036MCP
get_claim(id=687036)