Unverified70% confidenceBenchmarkExact time
Under the same experimental setup, the total time to generate 1016 tokens drops from 14.66 seconds to 5.03 seconds.
2
Sources
70%
Confidence
Long-term
Relevance
10/18/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedOn an 8GB GPU, the token generation speed is approximately 4.2 to 5 tokens/second, and decreases from around 6 tokens/second to approximately 4.2 as the context grows longer.78% similarUnverifiedPerplexity published self-tested latency (September 30): under 2 seconds for a few hundred input tokens, about 5 seconds for 90k tokens, about 14 seconds for 190k tokens, and about 23 seconds near the 262k limit.77% similarUnverifiedIn a case test, Gemma took approximately 13.78 seconds to analyze a three-page PDF financial report, generating 1,064 tokens at a speed of 16 tokens per second.77% similarUnverifiedarXiv's SpecDec-Hybrid paper reports a 2.3x wall-clock speedup on a 4-GPU node, reducing latency for 2k-token long-form generation from 12 seconds to about 5 seconds.76% similarUnverifiedIn a test scenario where eight agents each process 7.5k-token documents and a chat request is issued in the second second, Superfluid answers in 0.36 seconds while llama-server outputs no first token for more than 10 seconds, a first-token latency gap of about 30 times.75% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1060141API
curl https://kongchang.com/api/v1/knowledge/claims/1060141MCP
get_claim(id=1060141)