Unverified50% confidenceConceptExact time
RPM and TPM are two orthogonal dimensions of model API rate limiting: RPM constrains call frequency, independent of request body size; TPM constrains the total number of Tokens consumed per unit of time, and both take effect simultaneously, with a 429 returned as soon as either is hit first.
1
Sources
50%
Confidence
Long-term
Relevance
10/15/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedModern LLM rate limiting is a multi-dimensional throughput constraint that evaluates RPM, TPM, RPD and TPD/consumption limits simultaneously, returning HTTP 429 as soon as any dimension hits its ceiling.70% similarUnverifiedAzure's quota system typically uses tokens per minute (TPM) or requests per minute (RPM) as the unit of measurement; quotas are subscription-level totals that are shared competitively across different deployments.66% similarUnverified大模型调用的计费单位是Token而非请求次数，响应时间从毫秒级变为秒级甚至分钟级63% similarUnverifiedThe benchmark uses llama2.c locked to a specific commit, paired with TinyStories FP32 checkpoints (15M, 42M, 110M parameters); these are small models running on llama2.c rather than the full Llama 2.62% similarUnverifiedMicroGPT's 10M TPS figure implies that its model parameter count is very likely in the range of tens of thousands to hundreds of thousands, with the performance bottleneck shifting from compute-bound to memory-access-bound.61% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1034040API
curl https://kongchang.com/api/v1/knowledge/claims/1034040MCP
get_claim(id=1034040)