Unverified50% confidenceFactExact time
Flips are concentrated in the regions where the model's own confidence is low: the lowest confidence tertile has a flip rate of 54%, while the highest tertile has only 8%.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
11/9/2026
First Seen
Valid until: 2/7/2027
Sources
Related Entities
Related Claims
UnverifiedWhen given input-irrelevant junk messages, the model's maximum confidence drops from 99.9% in normal cases to 54.3%, with the probability spread across the options.78% similarUnverifiedOn the MedAbstain benchmark, the median appropriate abstention rate of the base models was only 8.3%, and after fine-tuning it further dropped to a median of 4.2%.74% similarUnverifiedThe data shows that 'purely independent modes' occur in fewer than 5% of cases.72% similarUnverifiedIn providing correct, domain-specific justifications, performance across different models ranged from 25.6% all the way to 76.9%.71% similarUnverifiedTop academic deepfake detectors can see their accuracy plummet from 99% to below 60% when faced with previously unseen generative models, a phenomenon known as the cross-model generalization problem.71% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1149599API
curl https://kongchang.com/api/v1/knowledge/claims/1149599MCP
get_claim(id=1149599)