Unverified50% confidenceBenchmarkExact time
In an NGS quality anomaly alert scenario, the model gave only a 0.63% pass probability, 77.21% confidence for human review, and 84.7% confidence for the moderate risk level.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/19/2026
First Seen
Valid until: 1/17/2027
Sources
Related Entities
Related Claims
UnverifiedThe model is well calibrated: mean predicted risk 0.469, actual observed rate 0.471, calibration slope 1.05, and every decile within 5 percentage points of the observed rate.74% similarUnverifiedWhen the model claims at least 90% confidence, its actual accuracy is only 56%, making it an extremely poorly calibrated model; therefore ReachNT hides the confidence percentage from tenants, and 42% of dangerous reports are routed to human handling before any decision is made.74% similarUnverifiedWhen given input-irrelevant junk messages, the model's maximum confidence drops from 99.9% in normal cases to 54.3%, with the probability spread across the options.73% similarUnverifiedDecision-1 was the only cloud model in the test that was fooled by a prompt injection command hidden in a comment, misclassifying the customer as happy with a probability of 0.68.69% similarUnverifiedThe NPV of definitive benign cases (0.73) still lags behind the malignant precision (0.94), indicating that the model has insufficient confidence in ruling out malignancy.68% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1069971API
curl https://kongchang.com/api/v1/knowledge/claims/1069971MCP
get_claim(id=1069971)