Unverified50% confidenceFactExact time
The author repeated the placebo test for each model 500 times with random sampling in order to characterize the empirical distribution of errors and calculate RMSE.
1
Sources
50%
Confidence
Long-term
Relevance
10/7/2026
First Seen
Sources
Related Entities
Related Claims
Unverified置换检验通过大量随机置换（通常1000到10000次）构建零假设下的经验分布来估计p值，无需参数假设但计算成本相对较高72% similarUnverified在5%显著性水平下测试100个随机因子，期望会有5个看起来显著（多重假设检验问题）72% similarUnverifiedWhen a team tests 1,000 combinations of strategy parameters, even if all combinations have zero predictive power, roughly 50 combinations will appear to perform excellently in backtesting purely due to randomness (the multiple comparisons problem).72% similarUnverifiedWhen testing LLM citation behavior, the same prompt should be run at least 20–50 times, ideally expanded to more than 100 times.71% similarUnverifiedThe experiment has a small sample size (single model, single test, 50 questions), is subject to random fluctuation, and constitutes a heuristic finding rather than a definitive conclusion.71% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/985860API
curl https://kongchang.com/api/v1/knowledge/claims/985860MCP
get_claim(id=985860)