Unverified50% confidenceBenchmarkExact time
The logical reasoning fix in gpt-5.4-mini caused the cost per correct answer to rise by 8.5 times.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/12/2026
First Seen
Valid until: 1/10/2027
Sources
Related Entities
Related Claims
UnverifiedOn the arithmetic control task, all models' accuracy stayed the same but the cost per correct answer rose by 1.65 to 2.5 times.74% similarUnverifiedAmong the 12 model × task combinations, only gpt-5.4-mini showed a statistically significant accuracy improvement on the logical reasoning task: jumping from 15% to 97.5%, with p=0.00056 after Holm correction.71% similarUnverifiedIn 7 of the 12 model × task combinations, high only changed the price while accuracy stayed the same, with the cost per correct answer rising by 1.5 to 3.4 times.68% similarUnverifiedSelf-Consistency can bring improvements of 5–20 percentage points on mathematical reasoning benchmarks such as GSM8K.64% similarUnverifiedgpt-oss-120b spent about 25 times the cost per correct answer on the distractor counting task, while its accuracy was 7.5 percentage points lower (not significant).64% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1007703API
curl https://kongchang.com/api/v1/knowledge/claims/1007703MCP
get_claim(id=1007703)