Unverified50% confidenceBenchmarkExact time
In a same-configuration comparison, single-request throughput at 38K improved from 69.38 tokens per second to 86.07, and 8-way total throughput at approximately 4K improved from 400.16 tokens per second to 464.15.
1
Sources
50%
Confidence
Long-term
Relevance
9/15/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedA 200K token context request requires approximately 25× the KV-Cache memory compared to an 8K token request.71% similarUnverifiedLangSmith's Agent trace payload has grown continuously: P50 grew from 6 KB to 37 KB, P99 grew from 364 KB to 12 MB, and a single customer once sent 50 TB of trace data in a single day.69% similarUnverifiedWhen the context expands from 4K tokens to 128K tokens (a 32× increase), the theoretical computation grows by approximately 1024×.67% similarUnverifiedGrok 4.5 outputs at 80 tokens per second and features a context window of up to 500,000 tokens (approximately 400,000 English words).66% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/923189API
curl https://kongchang.com/api/v1/knowledge/claims/923189MCP
get_claim(id=923189)