Unverified50% confidenceBenchmarkExact time
In 7 of the 12 model × task combinations, high only changed the price while accuracy stayed the same, with the cost per correct answer rising by 1.5 to 3.4 times.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/12/2026
First Seen
Valid until: 1/10/2027
Sources
Related Entities
Related Claims
UnverifiedOn the arithmetic control task, all models' accuracy stayed the same but the cost per correct answer rose by 1.65 to 2.5 times.80% similarUnverifiedIn a simulation of 2000 requests, the small model (1 unit cost/request) had an accuracy of 74.5% and a cost of 1.34 per correct answer; the large model (20 unit cost/request) had an accuracy of 95.8% and a cost of 20.88 per correct answer.74% similarUnverifiedBy selecting the appropriate model for different tasks, the solution rate improved by more than 23 percentage points, and the per-task cost was reduced to less than one-third of the original.72% similarUnverifiedToken pricing varies enormously across different models, and choosing the wrong model can result in several times the cost for batch tasks.72% similarUnverifiedWhen the coding agent no longer generates its own tests, the task success rate improves, overall speed increases by approximately 6%, and costs decrease by approximately 9%.71% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1007700API
curl https://kongchang.com/api/v1/knowledge/claims/1007700MCP
get_claim(id=1007700)