Partially Verified75% confidenceFactExact time
The pass@k family of metrics originates from the code generation evaluation field and was first systematically used in OpenAI's HumanEval paper.
3
Sources
75%
Confidence
Long-term
Relevance
10/9/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedThe pass@k metric is widely adopted on standard benchmarks such as HumanEval and MBPP.75% similarUnverifiedpass@1指标最初从代码生成评测领域（如HumanEval基准）借鉴而来，用于衡量模型一次生成正确代码的概率74% similarUnverifiedHumanEval基准测试由OpenAI于2021年随Codex模型论文一同发布，包含164道编程题，Pass@1指一次生成即通过全部测试用例的比例71% similarUnverifiedThe pass@k metric was first systematically defined in OpenAI's Codex paper, measuring the probability that at least one of k independent samples for the same problem is correct.71% similarVerifiedHumanEval was developed in-house by OpenAI and is specifically designed to test the functional correctness rate of code generation.68% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/991245API
curl https://kongchang.com/api/v1/knowledge/claims/991245MCP
get_claim(id=991245)