Unverified50% confidenceBenchmarkExact time
Among 64 adjacent version switches, the feedback score and the held-out score moved in the same direction only 34 times, a consistency rate of 53.1%.
1
Sources
50%
Confidence
Long-term
Relevance
10/15/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedIn the control group where the answer key was removed from the prompt, the match rate plummeted from 63% to 1% (1/75).69% similarUnverifiedWhen a 61% pass rate is observed on 64 samples, the 95% Wilson confidence interval is approximately 48% to 73%66% similarUnverifiedEven after the assertion output rate rose to 95%, 45 of the 63 features still ultimately had no verified capability description.66% similarUnverifiedUnder the condition of refreshing responses at every update, increasing prompt breadth improved accuracy from 23.61% to 25.57%.65% similarUnverifiedWhen the 35B model switched to a wider context, its pass rate plummeted to 46/90, with 43 responses truncated due to a fixed output budget.65% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1038291API
curl https://kongchang.com/api/v1/knowledge/claims/1038291MCP
get_claim(id=1038291)