Unverified50% confidenceBenchmarkExact time
Systems using the same or similar underlying models but with different harness designs can differ by more than 10–20 percentage points in fix success rate on SWE-bench.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
9/17/2026
First Seen
Valid until: 12/16/2026
Sources
Related Entities
Related Claims
Unverified在SWE-bench Full版本上，多数模型的通过率仍低于20%67% similarUnverified同一个精心设计的提示词在不同平台间直接复用时，输出质量可能出现20-40%的效果落差66% similarUnverifiedResearch shows that the performance gap between different prompt designs can exceed 10 percentage points even for the same model.64% similarUnverified相比默认调度策略，块调度可以将系统整体利用率提升15%-25%63% similarUnverified权重绑定在中小规模模型上(如GPT-2 124M)通常能提升性能并减少约30%的嵌入相关参数，但在超大规模模型中收益递减63% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/928015API
curl https://kongchang.com/api/v1/knowledge/claims/928015MCP
get_claim(id=928015)