[KongchangAI]
ConceptRetry Storm

Retry Storm

A cascading failure pattern in distributed systems in which downstream service failures cause large numbers of upstream requests to time out and trigger retries. The resulting retry traffic further increases load on downstream services, forming a positive feedback loop that can escalate a localized failure into a system-wide outage.

Core Facts

Timeline (last 90 days)

Oct 11

智能体对同一个失败的工具调用反复重试的失控模式被称为「重试风暴」(retry storm)

Unverified50%
Aug 29

Strategies for mitigating retry storms include exponential backoff, adding random jitter, setting retry budgets (e.g., limiting retry requests to no more than 10% of total requests), and the circuit breaker pattern.

Unverified50%
Aug 12

P95表示95%的请求延迟低于该值,P99表示99%的请求延迟低于该值,高分位数指标专门捕捉尾部延迟严重程度

Verified65%
Aug 9

Without exponential backoff, a brief server-side outage causes all failed clients to immediately retry simultaneously, forming a retry storm that is more destructive than the original traffic.

Verified65%

All Facts (4)

Source Articles