Unverified50% confidenceOpinionExact time
SWE-bench评估模型解决真实GitHub Issue的能力，被认为比HumanEval更贴近Agent实际工作场景
1
Sources
50%
Confidence
Long-term
Relevance
7/6/2026
First Seen
Sources
Connecting an Open-Source AI Assistant to OpenClaw: A Complete Local Agent Setup Guide
bilibili枫影剑wind7/4/2026
Related Claims
UnverifiedSWE-bench requires models to autonomously complete code modifications starting from real GitHub issues and pass test cases, making it closer to real-world engineering scenarios than HumanEval.82% similarUnverifiedSWE-bench requires models to resolve real software defects on GitHub and is the authoritative benchmark for evaluating agent-level programming capabilities.82% similarUnverifiedSWE-bench extracts tasks from real GitHub Issues, requiring models to fix real bugs in mainstream open-source projects, and is regarded as the gold standard for measuring the ability to actually solve engineering problems.76% similarUnverifiedGitHub的实践经验表明，人机协作模式（Agent提供建议由开发者审核确认）优于全自动化修复76% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/115479API
curl https://kongchang.com/api/v1/knowledge/claims/115479MCP
get_claim(id=115479)