Unverified50% confidenceBenchmarkExact time
In a benchmark of four enterprise agent architectures under 100 injected fault conditions (transient network timeouts, schema mismatches, empty search results), the naive self-reflection loop had an unconstrained runaway rate of 42.0%, median token consumption of 148,500 for failed tasks, mean time to failure of 18.4 minutes, and per-incident financial risk of $12.40.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/16/2026
First Seen
Valid until: 1/14/2027
Sources
Related Entities
Related Claims
UnverifiedOn a test set of 100 tickets, SupportOps-AI had an escalation error rate of 18%, a hallucination rate of 6%, an infinite-loop rate of 3%, and a complete failure/unresolved rate of 4%.75% similarUnverifiedIf a model has a 5% failure rate per 10-minute window, the success rate after four hours drops to only about 30%; reducing the per-10-minute failure rate from 5% to 3% brings the four-hour failure rate down from about 70% to about 50%75% similarUnverifiedFor a long-running task with a single-run success rate of only 85%, there will be 4–5 failures per month; raising it to 99% results in fewer than 1 expected failure per month, which approaches enterprise-level availability standards.74% similarVerifiedIn long-chain tasks, if each step has an error rate of approximately 5%, the overall success rate may drop to below 36% after 20 steps.73% similarUnverifiedIn the experiments, the task resolution rate was 17% for zero-shot generation, 27% for generic self-correction, 23% for error-only feedback, and 90% for diagnostic counterexample feedback (A-CEGIS).70% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1044037API
curl https://kongchang.com/api/v1/knowledge/claims/1044037MCP
get_claim(id=1044037)