Partially Verified65% confidenceBenchmarkExact time
The test covered four vision models: Claude Sonnet 5 (Anthropic), Gemini 3 Flash (Google), Gemini 3.1 Flash-Lite (Google), and GPT-5.4 nano (OpenAI).
3
Sources
65%
Confidence
Medium-term (~90 days)
Relevance
10/11/2026
First Seen
Valid until: 1/9/2027
Sources
Related Entities
Related Claims
UnverifiedThe median confidence difference across models when fabricating totals is enormous: Gemini 3 Flash and Flash-Lite at 95, GPT-5.4 nano at 62, and Claude Sonnet 5 at only 20.79% similarUnverifiedThe eight models tested include GPT-6 Luna, Claude Haiku 5.5, Gemini 3.5 Flash-Lite, Qwen 3 Next 80B, Gemma 4 31B, GPT-6 Sol, Claude Sonnet 5, and Gemini 3.7 Flash, with each model running 107 investigations per track.78% similarUnverifiedOpenAI has a product matrix ranging from GPT-4o mini to GPT-4o to o1/o3, Google's Gemini series is divided into four tiers—Nano, Flash, Pro, and Ultra—and Anthropic's Claude has three tiers: Haiku, Sonnet, and Opus.76% similarUnverifiedThe revised experiments use Gemini 3.7 Flash, Claude Sonnet 5.5, and GPT-5.4, with each model independently performing three optimization attempts, and prompts using temperature 0 and seed 0.76% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/997257API
curl https://kongchang.com/api/v1/knowledge/claims/997257MCP
get_claim(id=997257)