Unverified50% confidenceFactExact time
SWE-bench's scoring metric is the Resolved Rate, i.e., the proportion of Issues successfully resolved.
1
Sources
50%
Confidence
Long-term
Relevance
9/11/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedSWE-bench is a benchmark measuring models' ability to autonomously fix real GitHub Issues; early models had a resolution rate below 5%, and by 2025 mainstream products have surpassed 50%.63% similarUnverifiedThe Calmar Ratio divides annualized return by maximum drawdown, with an emphasis on penalizing tail risk.62% similarUnverifiedThe pass rate on the SWE-bench Verified subset jumped from under 5% in early 2024 to 49%.61% similarUnverifiedEvaluating backtested returns requires attention to risk-adjusted metrics such as the Sharpe ratio and maximum drawdown; a strategy with 30% annualized returns but a 60% maximum drawdown is inferior to one with 15% annualized returns but only a 10% drawdown.60% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/907386API
curl https://kongchang.com/api/v1/knowledge/claims/907386MCP
get_claim(id=907386)