Unverified50% confidenceBenchmarkExact time
In a customer-service ticket routing scenario, for a ticket involving a duplicate charge, the model gave 99.97% confidence for the billing category and 89.31% confidence for high priority.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/19/2026
First Seen
Valid until: 1/17/2027
Sources
Related Entities
Related Claims
UnverifiedThe benchmark produces two numbers for each model that are never merged: a task score and a false-confidence rate (the proportion of cases that should have been escalated but were answered anyway).68% similarUnverifiedWhen multiple models all achieve accuracy rates above 90% on benchmarks such as MMLU and HumanEval, user attention shifts to practical metrics such as inference latency, service availability, and total cost of ownership.66% similarUnverifiedA single performance percentage is misleading; a model that claims to retain 98% of performance may happen to fall within the lost 2% for a specific task type, and real tasks should be tested before trusting benchmarks.64% similarUnverifiedPrompt优先方案（用一条超长指令串起数据分析流程）实测成功率不到40%63% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1069970API
curl https://kongchang.com/api/v1/knowledge/claims/1069970MCP
get_claim(id=1069970)