Unverified50% confidenceBenchmarkExact time
In a standalone test of the "view incomplete" prompt on 100 questions, the wrong-answer rate was 16% without the prompt and dropped to 5% with it.
1
Sources
50%
Confidence
Short-term (~14 days)
Relevance
10/17/2026
First Seen
Valid until: 10/31/2026
Sources
Related Entities
Related Claims
UnverifiedIn the experiments, the task resolution rate was 17% for zero-shot generation, 27% for generic self-correction, 23% for error-only feedback, and 90% for diagnostic counterexample feedback (A-CEGIS).79% similarUnverifiedAmong the five evaluators the authors tested, if the answer key had minor errors, the score was only 0.21 — lower than giving no key at all (0.46) and lower than giving a completely irrelevant key (0.50); while a human-verified model-generated answer scored 0.61, close to the 0.69 of a human-written one.77% similarUnverifiedRanked by question difficulty, persistence rate was 91.4% on the 60 questions that all models answered correctly, but only 73.5% on the 52 questions that at least one model got wrong, indicating that sycophancy tracks uncertainty.76% similarUnverifiedThe sample size of this comparison experiment is limited: each question was asked twice, so the actual number of distinct questions covered is only about 14, and a single correct or incorrect answer greatly perturbs the conclusion.76% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1050462API
curl https://kongchang.com/api/v1/knowledge/claims/1050462MCP
get_claim(id=1050462)