Unverified50% confidenceBenchmarkExact time
Marginal gains were observed on the wood type task, but these were highly dependent on the chance results of a single seed
1
Sources
50%
Confidence
Long-term
Relevance
10/12/2026
First Seen
Sources
Related Entities
Related Claims
Unverified通过记录随机种子可精确复现导致失败的特定顺序，再通过二分法逐步缩小污染源的范围66% similarUnverifiedThe results of a single-task evaluation are subject to randomness, and the same model may produce noticeably different answers under different prompts and different random seeds.64% similarUnverified在某些任务上，仅因随机种子不同导致的性能波动幅度可能超过某些论文声称的方法创新带来的提升64% similarUnverifiedStage-level audits found that early wood harvesting and crafting steps frequently became bottlenecks, as agents getting stuck in prerequisite steps prevented higher-level capabilities from being observed63% similarUnverifiedZero-shot prediction results are cached and reused across random seeds, so this part does not constitute truly independent repeated experiments.62% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1001990API
curl https://kongchang.com/api/v1/knowledge/claims/1001990MCP
get_claim(id=1001990)