Verified75% confidenceFactTime unknown
SWE-bench Verified is a human-verified subset of approximately 500 samples, excluding tasks with vague descriptions or unreliable tests.
5
Sources
75%
Confidence
Long-term
Relevance
6/1/2026
First Seen
Sources
Qwen在SWE-bench持续领跑：开源AI编程模型的崛起
twitterSWEbench
Related Entities
Related Claims
VerifiedSWE-bench Verified is one of the authoritative industry leaderboards for AI programming ability, with human annotators filtering out samples with ambiguous descriptions or unstable tests.80% similarUnverified2024 年推出的 SWE-bench Verified 子集由人工筛选了 500 个高质量样本78% similarVerifiedSWE-bench Verified经过人工审核确保每个实例的质量和可解性70% similarUnverifiedSWE-bench Verified's scoring mechanism relies on an automated test suite; after a model submits a code patch, the system runs predefined unit tests to determine whether they pass67% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/26932API
curl https://kongchang.com/api/v1/knowledge/claims/26932MCP
get_claim(id=26932)