Unverified50% confidenceFactExact time
The original confirmatory logistic regression family rejected both planned null hypotheses in 4 of 12 tests, with the English direction exceeding the majority-class baseline by only 3.0-7.3 percentage points.
1
Sources
50%
Confidence
Long-term
Relevance
11/10/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedIn the selective classification framework, when model confidence is below the threshold τ=0.934, the sample is rejected and referred to an expert for review.71% similarUnverifiedTraditional benchmarks have become ineffective for evaluating model reasoning ability because almost every model may have seen the standard answers in its training data.70% similarUnverifiedRanked by question difficulty, persistence rate was 91.4% on the 60 questions that all models answered correctly, but only 73.5% on the 52 questions that at least one model got wrong, indicating that sycophancy tracks uncertainty.70% similarUnverifiedA first round of 80 cases is a reasonable lower bound for paired testing; the power of paired testing comes from discordant pairs, and a set where everything passes is useless no matter how large it is.70% similarUnverifiedIn tests with two sets of 120 evidence packages each, the model rejected 70% to 100% of the applicable counterexamples, while checks constructed against specific scopes correctly classified all evidence packages.69% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1153328API
curl https://kongchang.com/api/v1/knowledge/claims/1153328MCP
get_claim(id=1153328)