Rate Limit
A mechanism by which a server protects its own resources by restricting the frequency or number of requests a client may make within a given time window. Common implementations include token buckets and sliding windows.
Timeline (last 90 days)
Most third-party APIs limit the number of requests per unit time via token buckets or sliding windows, and exceeding the limit returns a 429 status code or even a temporary ban.
Setting the concurrency too high easily triggers downstream API rate limiting, causing retries and backoff, which instead lengthens the total time; setting it too low fails to compress end-to-end latency.
All Facts (2)
Most third-party APIs limit the number of requests per unit time via token buckets or sliding windows, and exceeding the limit returns a 429 status code or even a temporary ban.
50%UnverifiedSetting the concurrency too high easily triggers downstream API rate limiting, causing retries and backoff, which instead lengthens the total time; setting it too low fails to compress end-to-end latency.
50%