Unverified50% confidenceBenchmarkExact time
The out-of-the-box graph tool returned zero callers for 17 out of 26 functions, despite every one of them having actual callers, and every empty result was labeled as precise with a risk level of LOW.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/12/2026
First Seen
Valid until: 1/10/2027
Sources
Related Entities
Related Claims
UnverifiedEach model answered 112 questions (7 flaw types × 2 versions × 4 repetitions × 2 conditions), with half flawed and half sound, and a model that mechanically answered 'none' would receive a baseline score of 0.50.69% similarUnverifiedIn the experiments, the task resolution rate was 17% for zero-shot generation, 27% for generic self-correction, 23% for error-only feedback, and 90% for diagnostic counterexample feedback (A-CEGIS).67% similarUnverifiedRanked by question difficulty, persistence rate was 91.4% on the 60 questions that all models answered correctly, but only 73.5% on the 52 questions that at least one model got wrong, indicating that sycophancy tracks uncertainty.67% similarUnverifiedAcross all 68 task-paradigm combinations, in 35.3% of them PPG foundation models show no meaningful advantage over the random/constant baseline.65% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1004253API
curl https://kongchang.com/api/v1/knowledge/claims/1004253MCP
get_claim(id=1004253)