Unverified50% confidenceFactExact time
When a precedent conflicting with the default preference exists in the repository, agents follow the precedent almost without exception—in 360 relevant trials, 359 chose the precedent.
1
Sources
50%
Confidence
Long-term
Relevance
10/30/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedChecking consistency through random sampling yields an inflated consistency rate because most samples are simple, masking the regions that are truly problematic.67% similarUnverifiedAnytime-valid methods based on test martingales are designed to avoid the type I error inflation caused by traditional p-values in scenarios of multiple testing or continuous monitoring.67% similarUnverifiedThe experiment has clear boundaries: a single task (invoice extraction), a single model family, and only 4 repetitions per size point; the 95% confidence interval for 25% is very wide, algorithmic padding is not entirely equivalent to hand-written bloat, and the conclusions should be regarded as a measurement starting point with a clear mechanism rather than a universal constant.66% similarUnverifiedRunning the development set twice under identical settings, the same design's correctness varied by 1 to 5 questions on the same 36 questions, showing non-negligible random fluctuation.66% similarUnverifiedA manual analysis of 250 error cases by the research team revealed that retrieval failure remains the primary bottleneck, with incorrect entity evidence being a particularly prominent issue.65% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1114377API
curl https://kongchang.com/api/v1/knowledge/claims/1114377MCP
get_claim(id=1114377)