Unverified50% confidenceOpinionExact time
The cost-per-correct-answer metric simultaneously penalizes both extremes: high failure rate but cheap, and high success rate but expensive.
1
Sources
50%
Confidence
Long-term
Relevance
10/12/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedThe metric truly worth tracking is cost per correct answer, because it is the only metric that cannot be optimized by failing more quietly.74% similarUnverifiedFailed retries across multiple models may accumulate actual costs, and if only the cost of the successful attempt is recorded, billing attribution becomes distorted.71% similarUnverifiedWhen multiple models are tied on accuracy, the cost per flawless run becomes the truly useful tiebreaker metric.71% similarUnverifiedA model with slightly lower accuracy but five times cheaper may outperform on the valid findings per dollar metric, provided tiered routing is used to cover high-risk scenarios.68% similarUnverifiedTreating every failure as an equally weighted deduction is a serious evaluation pitfall, as an average score of 95% can mask the most costly and irreversible failures within that 5%.68% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1003284API
curl https://kongchang.com/api/v1/knowledge/claims/1003284MCP
get_claim(id=1003284)