Unverified70% confidenceFactExact time
The pass@k metric was first systematically defined in OpenAI's Codex paper, measuring the probability that at least one of k independent samples for the same problem is correct.
2
Sources
70%
Confidence
Long-term
Relevance
9/7/2026
First Seen
Sources
Related Entities
Related Claims
Unverifiedpass@k指标衡量模型生成k个候选代码片段时至少有一个能通过全部测试用例的概率71% similarPartially VerifiedThe pass@k family of metrics originates from the code generation evaluation field and was first systematically used in OpenAI's HumanEval paper.71% similarUnverifiedpass@k is a commonly used metric for measuring sampling quality in tasks such as code generation: k candidate answers are independently sampled for the same problem, and success is counted as long as any one of them passes verification.70% similarUnverifiedHumanEval基准测试由OpenAI于2021年随Codex模型论文一同发布，包含164道编程题，Pass@1指一次生成即通过全部测试用例的比例68% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/873220API
curl https://kongchang.com/api/v1/knowledge/claims/873220MCP
get_claim(id=873220)