Concepttokens/秒 / TPS
tokens per second
A common unit for measuring the inference speed of large models, referring to the number of language tokens a model generates per second, used to measure the model's output throughput performance.
Timeline (last 90 days)
Sep 28
t/s (tokens per second) is a commonly used performance metric in the local large model community
Unverified50%