Unverified50% confidenceCautionExact time
FrontierCode benchmark results from different versions or different sampling strategies (such as pass@1 and pass@k) cannot be directly compared across the board.
1
Sources
50%
Confidence
Long-term
Relevance
10/12/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedFrontierCode 1.1's test cases are typically derived from real open-source projects and require models to have cross-file context understanding and long-sequence reasoning capabilities.67% similarUnverified在Pass@1 Codeforces基准测试中，o1和o1 pro得分非常接近63% similarUnverifiedDifferences in evaluation setups across laboratories (such as pass@k, chain-of-thought prompting, and code execution tools) cause the same model to show different scores in different reports, complicating cross-laboratory comparisons.63% similarUnverifiedpass@1指标最初从代码生成评测领域（如HumanEval基准）借鉴而来，用于衡量模型一次生成正确代码的概率61% similarUnverified同一个模型用同一套假设检查自己的代码天然看不到盲点，跨模型审查因训练侧重点不同才具备互补价值61% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1010673API
curl https://kongchang.com/api/v1/knowledge/claims/1010673MCP
get_claim(id=1010673)