Unverified50% confidenceBenchmarkExact time
vLLM provides day-0 support for NVIDIA Vera Rubin NVL72, reporting 7.8x throughput per GPU versus GB200 NVL72 (AgentX) and 3.7x VLM throughput versus GB300 (MLPerf v6.1), with locality domains tuned for MoE routing.
1
Sources
50%
Confidence
Short-term (~14 days)
Relevance
10/14/2026
First Seen
Valid until: 10/28/2026
Sources
Related Entities
Related Claims
UnverifiedvLLM v0.27.0 enables the sm_107 target for the NVIDIA Rubin architecture and provides an NVLink all-reduce path on SM107.73% similarUnverifiedvLLM is primarily optimized for NVIDIA GPUs and offers less support for CPU inference and low-end hardware than llama.cpp.72% similarUnverifiedvLLM configuration parameters include --tensor-parallel-size (tensor parallelism degree), --gpu-memory-utilization (GPU memory usage ratio cap), --max-num-batched-tokens (maximum number of batched tokens), and others.70% similarUnverifiedOpen-source models such as LLaMA 3, Mistral, and Qwen 2.5 can already run smoothly on mainstream consumer-grade GPUs (such as the RTX 4090) at parameter scales ranging from 7B to 14B.68% similarUnverifiedThe parallelism setting in vLLM must match the actual number of GPUs; setting GPU memory utilization too high causes OOM crashes, while setting it too low wastes hardware resources.68% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1026266API
curl https://kongchang.com/api/v1/knowledge/claims/1026266MCP
get_claim(id=1026266)