Unverified50% confidenceFactExact time
On math tasks, the accuracy was 79% when the model wrote out reasoning steps, and only 11% when it gave a bare number.
1
Sources
50%
Confidence
Long-term
Relevance
10/13/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedRanked by question difficulty, persistence rate was 91.4% on the 60 questions that all models answered correctly, but only 73.5% on the 52 questions that at least one model got wrong, indicating that sycophancy tracks uncertainty.75% similarUnverifiedModels' standard accuracy on the passage-level ranking task was only 0% to 13%.75% similarUnverifiedFor the 7B model, accuracy with the solver was 75.31% versus 72.02% for direct calculation, a paired improvement of +3.29 percentage points, with a 95% cluster interval of [-3.49, 10.38] crossing zero, making the advantage non-significant.75% similarUnverifiedProblem quality control requires the model to have an accuracy above 80% at n=10, temperature=0.8, and without chain-of-thought, and the intermediate quantities must never appear in the prompt.72% similarUnverifiedIn a sandwich determination demo, the model returned 94% true and 6% false, with the entire decision taking 93 milliseconds.72% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1018308API
curl https://kongchang.com/api/v1/knowledge/claims/1018308MCP
get_claim(id=1018308)