Unverified50% confidenceBenchmarkExact time
Official data shows that on a single B200, LFM2.5-1.2B's p95 latency on RIPL is 14.4 to 28.4 times lower than Qwen3.5-0.8B's on vLLM.
1
Sources
50%
Confidence
Short-term (~14 days)
Relevance
10/22/2026
First Seen
Valid until: 11/5/2026
Sources
Related Entities
Related Claims
Unverifiedqwen3.8 had a latency p50 of 18885ms and p95 of 42368ms, 15 to 20 times slower than Claude Sonnet 5's 1080ms median latency on the same task.74% similarUnverifiedThe Q4_K_M/GGUF version of Qwen 27B decodes at approximately 10.7 tok/s on the same machine, roughly 1/3.8 of the MLX version.73% similarUnverifiedAt batch 1, the RTX 3090's inference throughput is about 1.03~1.09 times that of the L40S (based on Qwen2.5 1.5B/7B models, measured on vLLM 0.27.1).70% similarVerifiedWhen using FP16 precision, the KV Cache for LLaMA-2-7B occupies approximately 0.5 MB per token.70% similarVerifiedIn benchmark testing, Qwen3 27B achieved a generation speed of approximately 40-something tokens per second on 4 modified 2080 Ti cards without NVLink enabled.68% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1086971API
curl https://kongchang.com/api/v1/knowledge/claims/1086971MCP
get_claim(id=1086971)