Unverified50% confidenceFactExact time
TPM counts the total number of Tokens consumed per request, derived by adding input Tokens to output Tokens; input Tokens include user messages, system prompts, tool definitions, and all conversation history sent back in previous Agent turns, while output Tokens include visible text and reasoning Tokens.
1
Sources
50%
Confidence
Long-term
Relevance
10/15/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedTime Per Output Token (TPOT) measures the speed at which a model generates tokens one by one during the autoregressive decoding phase.73% similarUnverifiedThroughput is typically measured in tokens generated per second (tokens/s), determining how many concurrent requests a system can serve simultaneously.66% similarUnverifiedLLM inference latency is typically broken down into Time To First Token (TTFT) and Time Per Output Token (TPOT).64% similarUnverified该工具提供Token用量查看功能,用户可实时监控消耗情况64% similarUnverified对于单用户交互式场景推理速度达到5-10 token/s通常就能提供流畅体验,而代码生成、长文档摘要或多轮Agent调用往往需要30 token/s以上63% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1034045API
curl https://kongchang.com/api/v1/knowledge/claims/1034045MCP
get_claim(id=1034045)