Expired50% confidenceFactExact time
Both the 87% pass rate and the 55% time advantage come from a single source (the author of the original Reddit post) and lack third-party reproduction.
1
Sources
50%
Confidence
Short-term (~14 days)
Relevance
10/15/2026
First Seen
This claim has expired. It is kept for the record and no longer describes the current state.
Valid until: 10/29/2026(expired)
Sources
Related Entities
Related Claims
UnverifiedThe 11% error rate in the study is an upper bound, because the analysis pipeline cannot fully capture dynamic content such as Reddit posts and YouTube videos.64% similarUnverifiedIn the controlled test, the cache hit rate increased from 76.1% to 85.4%.64% similarUnverifiedIn the control group where the answer key was removed from the prompt, the match rate plummeted from 63% to 1% (1/75).64% similarUnverifiedThe author deliberately introduced a genuine severe regression that reduced an agent's success rate from 92% to 52%, yet the statistical rule originally designed for this purpose passed the PR because the regression was concentrated in a small number of tasks rather than being uniformly distributed.62% similarUnverifiedAccording to the service's public records: across 27 verbatim-recorded everyday judgments where both options were defensible, the reported separation fell between 27.3% and 88.3%, with a median of 74.0%, and none exceeded 90%.62% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1040027API
curl https://kongchang.com/api/v1/knowledge/claims/1040027MCP
get_claim(id=1040027)