Unverified50% confidenceFactExact time
success@k is a batch evaluation metric: given k candidate ideas, if at least some number of them are judged successful by a downstream experiment or human, it counts as one hit; it measures whether a feasible solution can be found within a set of outputs.
1
Sources
50%
Confidence
Long-term
Relevance
10/16/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedCherry-picking runs refers to selecting and reporting the highest score from multiple runs on the same questions, which measures the upper bound of the model's luck rather than stable expected performance.69% similarUnverified结果层的核心指标是任务整体成功率（Task-level Success）69% similarUnverified3 次以上的独立采样才能提供足够的方差估计，使创意评估从运气判断升级为概率判断，是生产级提示词评估的最佳实践68% similarUnverifiedKPI emphasizes assessing results with quantifiable metrics, while OKR emphasizes setting challenging goals and tracking progress with measurable key results.68% similarUnverifiedpass@k is a commonly used metric for measuring sampling quality in tasks such as code generation: k candidate answers are independently sampled for the same problem, and success is counted as long as any one of them passes verification.67% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1041917API
curl https://kongchang.com/api/v1/knowledge/claims/1041917MCP
get_claim(id=1041917)