Unverified50% confidenceBenchmarkExact time
METR follow-up experiment data: the returning-developer group showed -18% speedup with a confidence interval of -38% to +9%; newly recruited developers showed -4% speedup with a confidence interval of -15% to +9%, and both confidence intervals cross zero.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/18/2026
First Seen
Valid until: 1/16/2027
Sources
Related Entities
Related Claims
UnverifiedOn July 10, 2025, METR published a randomized controlled trial: 16 senior open-source developers handled 246 tasks on real repositories, and after using AI tools they were actually 19% slower, despite prior expectations of a 24% speedup and post-hoc self-reported estimates of a 20% speedup.78% similarUnverified微软研究院和GitHub联合研究显示，经验较少的开发者使用Copilot报告的生产力提升幅度通常为40%-60%，远高于资深开发者的15%-25%74% similarUnverifiedIf a developer's work is primarily high-frequency iteration and prototyping, the value of unlimited daily usage at 50x capacity may outweigh the 9% performance gap; for those with the highest requirements for code quality, the option to switch to a top-tier paid model can be retained.68% similarUnverifiedIn a two-phase coordination-proxy development comparison, both the baseline and the source-author-written candidate completed 180/180 trials; the candidate used 37.11% fewer tokens, reduced estimated endpoint cost by 33.84%, and decreased steps by 11.63%, but improvement in quality, latency, or production-environment behavior cannot be demonstrated.67% similarUnverifiedThe developer states that their maintenance work proportion swings between 8.7% and 26.2% depending on the interpretation, because the specific composition of the residual cannot be measured precisely.67% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1061006API
curl https://kongchang.com/api/v1/knowledge/claims/1061006MCP
get_claim(id=1061006)