Unverified70% confidenceFactTime unknown
GPU interconnect bandwidth within data centers is typically on the order of 100–400 Gbps (via InfiniBand HDR/NDR or NVSwitch), while wide-area network bandwidth between data centers may be only 1–10 Gbps.
2
Sources
70%
Confidence
Long-term
Relevance
6/1/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedGPUs transmit gradient data via InfiniBand or RoCE protocols, with bandwidth reaching 400 Gbps per card or higher.80% similarUnverifiedSwapping KV cache in and out depends on the interconnect bandwidth between host memory and GPU VRAM; taking PCIe 4.0 x16 as an example, the one-way effective bandwidth is on the order of about 25 GB/s, while the HBM bandwidth of a single data center GPU can reach 2–3 TB/s, a difference of about two orders of magnitude.76% similarUnverifiedGPU video memory (VRAM) bandwidth is typically on the order of 500–1,000 GB/s, whereas DDR5 system memory bandwidth is only approximately 50–80 GB/s, a difference of more than 10x.76% similarUnverifiedIn thousand-GPU-scale clusters, InfiniBand networks provide 400 Gbps of cross-node bandwidth.76% similarVerified在H100 NVLink架构中，单台服务器内8块GPU可通过NVSwitch全互联，总带宽达900GB/s，相比PCIe 5.0的64GB/s有数量级提升73% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/22916API
curl https://kongchang.com/api/v1/knowledge/claims/22916MCP
get_claim(id=22916)