Unverified50% confidenceFactExact time
SlopCodeBench is a benchmark for code generation tasks that uses a checkpoint mechanism to evaluate whether model outputs satisfy a series of functional and quality requirements.
1
Sources
50%
Confidence
Long-term
Relevance
10/21/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedSlopCodeBench measures a model's overall performance under real, messy, low-quality (slop) code inputs, rather than only single-turn code generation accuracy.78% similarUnverifiedThe Slop Code Bench benchmark simulates real development scenarios of multiple rounds of iteration and continuous feature additions, examining the long-term maintainability of codebases.78% similarUnverifiedSlop Code Bench's approach is to first have the model build a project from scratch, then continuously append features, with each challenge containing 3 to 10 checkpoints.77% similarUnverifiedSWE-Bench主要依赖单元测试是否通过来判定任务成功与否,但通过测试并不等于代码质量过关73% similarUnverifiedThese SlopCodeBench results come from an October run of a single benchmark, with certain limitations in sample scope and task types; the relationship between reasoning effort and code quality may vary by model version and task domain.73% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1081132API
curl https://kongchang.com/api/v1/knowledge/claims/1081132MCP
get_claim(id=1081132)