Unverified50% confidenceFactExact time
Audit log statistics show that among the four models used, two models produced hundreds of real operations through the harness, while the other two produced zero real operations.
1
Sources
50%
Confidence
Long-term
Relevance
10/13/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedThe benchmark produces two numbers for each model that are never merged: a task score and a false-confidence rate (the proportion of cases that should have been escalated but were answered anyway).66% similarUnverifiedThe method preserved all 40/40 genuine responses on each of the two models, with zero false suppressions.64% similarUnverifiedLow-confidence requests first fail on the small model and then fall back to the large model with the same context for a second generation, causing such requests to incur the cost of two generations and resulting in double payment.63% similarUnverifiedEach model was paired with four prompt types—zero-shot, few-shot, chain-of-thought, and few-shot plus chain-of-thought—each in two groups, producing approximately 52,000 labels in total.62% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1017597API
curl https://kongchang.com/api/v1/knowledge/claims/1017597MCP
get_claim(id=1017597)