Unverified50% confidenceBenchmarkExact time
In the SHADE-Arena evaluation, the probe reached 98.8% AUC, surpassing the Opus 5.5-based text monitoring baseline.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/13/2026
First Seen
Valid until: 1/11/2027
Sources
Related Entities
Related Claims
UnverifiedGPT-6 Astra achieved a near-perfect score of 99.9% on ARC-AGI-type tests, while the average score of ordinary human test-takers was only 48%.66% similarUnverifiedAUC is the standard metric for measuring the performance of a binary classifier, with values from 0.5 to 1.0, and 98.8% AUC means that in about 99% of sample pairs, the probe can correctly rank conversations containing deception ahead of conversations without deception.66% similarUnverifiedIn introspection-style deception tests, the probe needs to distinguish conversation records containing the model's true hidden objective from records containing other objectives, and the probe's AUC reaches as high as 99.7%.66% similarUnverifiedArcFace achieved a verification accuracy of 99.83% on the LFW dataset.64% similarUnverifiedThe model achieves an accuracy of 96.88% on an unseen evaluation set.64% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1013464API
curl https://kongchang.com/api/v1/knowledge/claims/1013464MCP
get_claim(id=1013464)