Unverified50% confidenceFactExact time
SWE-bench uses an end-to-end evaluation model: given a GitHub issue, the agent operates autonomously on the code repository, with the sole criterion being whether it can pass the test cases corresponding to that issue.
1
Sources
50%
Confidence
Long-term
Relevance
9/21/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedSWE-bench Verified's scoring mechanism relies on an automated test suite; after a model submits a code patch, the system runs predefined unit tests to determine whether they pass77% similarUnverifiedSWE-bench测试样本取自真实GitHub仓库的历史Issue，评分标准是能否通过仓库原有的完整测试套件77% similarUnverifiedThe SWE-bench benchmark has become the industry standard for evaluating the coding capabilities of AI agents, containing software engineering tasks extracted from real GitHub repositories.76% similarVerifiedSWE Bench is a software engineering benchmark proposed by Princeton University that specifically evaluates AI models' ability to resolve real GitHub Issues.72% similarUnverifiedHumanEval、SWE-bench等代码评测基准的排名是评估执行型Agent底层模型选型的重要参考维度72% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/939130API
curl https://kongchang.com/api/v1/knowledge/claims/939130MCP
get_claim(id=939130)