Unverified50% confidenceFactExact time
ProgramBench is an evaluation benchmark for programming tasks that typically presents function-level or repository-level programming problems and measures results with metrics such as unit test pass rate.
1
Sources
50%
Confidence
Long-term
Relevance
10/25/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedSlopCodeBench is a benchmark for code generation tasks that uses a checkpoint mechanism to evaluate whether model outputs satisfy a series of functional and quality requirements.77% similarUnverifiedThe effectiveness of ProgramGym has been validated on the ProgramBench benchmark.75% similarVerifiedTerminal-Bench is a benchmark specifically designed to evaluate AI models' ability to execute complex tasks in command-line environments, covering scenarios such as file operations, script writing, and system debugging.72% similarUnverifiedSWE-Bench主要依赖单元测试是否通过来判定任务成功与否,但通过测试并不等于代码质量过关69% similarUnverifiedLong-horizon coding benchmarks (such as SWE-bench) evaluate a model's ability to handle repository-level tasks, including reading codebases, locating bugs, making cross-file modifications, and passing tests.68% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1095448API
curl https://kongchang.com/api/v1/knowledge/claims/1095448MCP
get_claim(id=1095448)