Unverified50% confidenceBenchmarkExact time
On legal texts the model has never seen, 93.6% of questions rank the correct passage in the top ten, compared with 80.2% for the baseline.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
11/3/2026
First Seen
Valid until: 2/1/2027
Sources
Related Entities
Related Claims
UnverifiedOn math tasks, the accuracy was 79% when the model wrote out reasoning steps, and only 11% when it gave a bare number.69% similarUnverifiedUnder the confusion matrix scenario set in the article, the false positive rate is about 72.73%.69% similarUnverifiedOn 120 template-related requests, the full workflow achieved 98.3% first-round specification and decision accuracy, versus 92.5% for pattern-assisted single attempts and 82.5% for the model-only approach.68% similarUnverifiedOn the same questions, merely changing the answer extraction method from pattern matching to an explicit \boxed{} format raised accuracy from 20.8% to 93.9%.67% similarUnverifiedRanked by question difficulty, persistence rate was 91.4% on the 60 questions that all models answered correctly, but only 73.5% on the 52 questions that at least one model got wrong, indicating that sycophancy tracks uncertainty.67% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1129325API
curl https://kongchang.com/api/v1/knowledge/claims/1129325MCP
get_claim(id=1129325)