Unverified50% confidenceBenchmarkExact time
On invalid propositions, using verifier feedback yielded 23/39 accepted counterexamples, while generic feedback without a checker yielded only 15/39.
1
Sources
50%
Confidence
Long-term
Relevance
10/16/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedIn tw-exam-bench, the answer-key consistency rate for 31,312 groups of duplicated questions reached 99.91%, and the only 27 discrepancies were verified and attributed one by one.76% similarUnverifiedOf the 186 comments that reviewers separately marked as having no clear ruling under policy, 39% fell into Jev's uncertain range (0.3-0.7), while only 14% of clear cases did.73% similarUnverifiedIn the experiments, the task resolution rate was 17% for zero-shot generation, 27% for generic self-correction, 23% for error-only feedback, and 90% for diagnostic counterexample feedback (A-CEGIS).73% similarUnverifiedIn validation testing, the model refused all 27 requests for prohibited capabilities and all 23 requests for unsupported operations.70% similarUnverifiedOf the 35 denials, 33 were for the reason bad_or_unscoped_token, and one each was triggered by an unknown provider and the daily request cap.69% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1046937API
curl https://kongchang.com/api/v1/knowledge/claims/1046937MCP
get_claim(id=1046937)