Unverified50% confidenceFactExact time
DataBugBench testing covers five models: Claude 3.5 Sonnet, GPT-4o, Gemini 1.5 Pro, Qwen 2.5 Coder 32B, and Llama 3.3 70B.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/12/2026
First Seen
Valid until: 1/10/2027
Sources
Related Entities
Related Claims
UnverifiedThe benchmark covers 9 models from 6 labs, including Qwen3 235B, Claude Haiku 4.5, Claude Opus 5.5, Gemini series, GPT-5.4 series, GLM-5, and Grok 4.20, of which 4 are reasoning models.77% similarUnverifiedIn the easy-to-verify category, seven models scored a perfect 40/40 across all six bait types, and Claude Sonnet 5.5, Gemini 3.7 Flash, and GPT-6.1 Sol answered every question correctly across all six tasks in both the easy and hard categories.71% similarUnverifiedThe dataset covers four open-weight models — Qwen2.5-7B, Mistral-7B-v0.3, Phi-3.5-mini, and Qwen2.5-1.5B — with 30 trajectories each.70% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1003531API
curl https://kongchang.com/api/v1/knowledge/claims/1003531MCP
get_claim(id=1003531)