Unverified50% confidenceBenchmarkExact time
On the demo PR, prbot using the gpt-4.1-mini model successfully fixed all 3 bugs, with the entire process taking 24.7 seconds, consuming about 17k tokens at a cost of about $0.008.
1
Sources
50%
Confidence
Short-term (~14 days)
Relevance
10/27/2026
First Seen
Valid until: 11/10/2026
Sources
Related Entities
Related Claims
UnverifiedUnder an assumed Agent bug-fixing session of 40 calls, 1.2 million input tokens (90% cache hit rate) and 60,000 output tokens, calculated at AIHubMix list prices, Flash 1017 costs $0.118 at peak hours and $0.059 off-peak; Pro 0813 costs $0.469 at peak and $0.233 off-peak; Pro costs about four times as much per session as Flash.66% similarUnverifiedIn a customer service chatbot scenario of 1 million tokens per month, calculated at GPT-5's $15 per million input tokens and factoring in a 15% retry rate and 20% system prompt overhead, the actual daily cost is 34% higher than a naive calculation.66% similarUnverifiedOn the same two-bug repair task, omitting the effort field (default max) consumes an average of 6,364 thinking tokens, 56 seconds, and $0.0045 per repair, whereas the low setting uses an average of only 591 thinking tokens, 9.5 seconds, and $0.0006.66% similarUnverifiedThe experiments use three mid-tier judges: two local models (Qwen 9B/4B, run via Ollama) and one gpt-4o-mini, with total API spending of $0.29.65% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1104607API
curl https://kongchang.com/api/v1/knowledge/claims/1104607MCP
get_claim(id=1104607)