Unverified50% confidenceBenchmarkExact time
In SemiAnalysis's AgentX benchmark, an 8-GPU AMD MI355X achieved 7,567 tok/s per GPU in Kimi K3 model serving at an interactive latency of 50 tok/s/user.
1
Sources
50%
Confidence
Short-term (~14 days)
Relevance
10/17/2026
First Seen
Valid until: 10/31/2026
Sources
Related Entities
Related Claims
UnverifiedUnder the same benchmark conditions, the per-GPU throughput of the 8-GPU AMD MI355X is 24.4% higher than the 6,083 tok/s/GPU of the HGX B300.73% similarUnverifiedRunning Kimi K2.5 on an NVIDIA B200 with real coding agent trajectories (SWE-smith, EvalScope evaluation), TokenSpeed outperforms TensorRT-LLM across the entire latency/throughput curve; at batch size 1 it is about 9% faster, and at about 100 tokens/second per user its throughput is about 11% higher.73% similarUnverifiedIn the test, model loading took only a few seconds, GPU usage dropped from 23GB to about 17GB, the first test prompt processing took 225ms, generation speed was stable at 33.5 tok/s, with a total output of 1500 tokens.69% similarUnverifiedA user runs the 397B model in FP8 on 8× GB10 units at a speed 20% faster than INT4, and published the first solution for MiMo 2.5 Pro and Kimi 2.6 on the NVIDIA forums.67% similarUnverifiedJev's reported server time is approximately 88 milliseconds per classification, while running GLiNER 2.5 small locally on a MacBook M4 Pro GPU is approximately 8 times faster.67% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1050929API
curl https://kongchang.com/api/v1/knowledge/claims/1050929MCP
get_claim(id=1050929)