Unverified50% confidenceFactExact time
tpm (Tokens Per Minute) and rpm (Requests Per Minute) are two independent rate-limiting dimensions in LiteLLM; rpm protects concurrent connection counts, while tpm aligns more closely with actual computational load.
1
Sources
50%
Confidence
Long-term
Relevance
10/11/2026
First Seen
Sources
Related Entities
Related Claims
VerifiedGPT-2 comes in four sizes: 117M, 345M, 762M, and 1.5B parameters.58% similarUnverifiedGPT-4-level models typically achieve 30–80 TPS on consumer-grade APIs, while optimized small models or dedicated inference hardware can reach 200+ TPS.58% similarUnverifiedThe LLM node generated by Crew Studio by default is a GPT model, which needs to be manually changed to Nemotron with the maximum execution time set to unlimited.56% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/998085API
curl https://kongchang.com/api/v1/knowledge/claims/998085MCP
get_claim(id=998085)