Unverified50% confidenceBenchmarkExact time
Re-verification of the Higgins pairing task fully reproduced all saved scores with zero mismatches, with a strict success rate of 120/120 under the clean condition and 119/120 under the injected condition.
1
Sources
50%
Confidence
Long-term
Relevance
10/12/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedIn the Phase 1 post-hoc comparison, SAGE's evaluation results were compared against 105 human reviews from the original competition, yielding an ordinal consistency of kappa = 0.29, which falls in the "fair" range.63% similarUnverifiedActionable Agent evaluation thresholds include a task decomposition rate and tool selection accuracy of 90% or above, a closed-loop completion rate of no less than 85%, and an error recovery rate of no less than 80%.62% similarUnverifiedThe pre-test execution baseline is fixed at: contribution value 1650, points 1000, and both orders and two types of transaction records at 0.62% similarUnverifiedRanked by question difficulty, persistence rate was 91.4% on the 60 questions that all models answered correctly, but only 73.5% on the 52 questions that at least one model got wrong, indicating that sycophancy tracks uncertainty.61% similarUnverifiedIn the experiments, the task resolution rate was 17% for zero-shot generation, 27% for generic self-correction, 23% for error-only feedback, and 90% for diagnostic counterexample feedback (A-CEGIS).61% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1002478API
curl https://kongchang.com/api/v1/knowledge/claims/1002478MCP
get_claim(id=1002478)