Unverified50% confidenceBenchmarkExact time
Across all 68 task-paradigm combinations, in 35.3% of them PPG foundation models show no meaningful advantage over the random/constant baseline.
1
Sources
50%
Confidence
Long-term
Relevance
10/12/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedRanked by question difficulty, persistence rate was 91.4% on the 60 questions that all models answered correctly, but only 73.5% on the 52 questions that at least one model got wrong, indicating that sycophancy tracks uncertainty.72% similarUnverifiedA WANDR score of 0.610 does not mean the model fully succeeds on 60% of tasks; the actual partial completion rate is related to the distribution of task complexity.71% similarUnverifiedAbout half of the tasks are easy for all models, with scores close to 100%; on the other half of difficult tasks, the three models scored 50%, 45%, and 23% respectively.70% similarUnverifiedOn a test subset of 152 completely untouched questions, anchored hybrid retrieval achieved 42.11%, while the planner-guided method reached only 36.84%.70% similarUnverifiedOn performance model code construction tasks, the average pass rate of all model configurations other than GPT-5.6 Sol was below 15%, with extremely large fluctuations across multiple runs.68% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1001378API
curl https://kongchang.com/api/v1/knowledge/claims/1001378MCP
get_claim(id=1001378)