[KongchangAI]
Unverified50% confidenceBenchmarkExact time

The letter-counting task broke nearly all models, with Claude Haiku 4.5 holding firm only 8.3% of the time and Grok holding firm 25% of the time.

1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/11/2026
First Seen
Valid until: 1/9/2027

Sources

Stress-Testing LLMs: Simple Doubt Changes Nothing, But a Confident Wrong Answer Breaks Them

Related Entities

Claude Haiku 4.5modelGrok 4.20model

Related Claims

UnverifiedThe intelligent routing solution passes 9/12 (75%) tasks and Opus passes 11/12 (92%); of the three failures, two unit test tasks and one QA task were routed to Claude Haiku 5.5, whose responses exceeded the 8,000-token limit.63% similar

Cite This Claim

Stable URI
https://kongchang.com/claim/998770
API
curl https://kongchang.com/api/v1/knowledge/claims/998770
MCP
get_claim(id=998770)