H200
An NVIDIA GPU based on the Hopper architecture, equipped with HBM3e memory and aimed at high-performance computing and AI training and inference.
Core Facts
Timeline (last 90 days)
In GPU Index's price data snapshot, the lowest price for H100 is $1.37/hr (Vast.ai, spot instance), for H200 is $2.62/hr (CoreWeave, spot), for A100 is $1.15/hr (Paperspace, three-year contract), for L40S is $0.79/hr (RunPod, community cloud), and for B200 is $4.26/hr (CoreWeave, spot).
These optimizations brought up to a 10% throughput improvement and up to a 9% improvement in time to first token (TTFT) on H200 GPUs.
JetBrains self-reported data: Mellum2.1 reaches 7,969 tokens/s on a single H200, while Qwen3.5-9B reaches 4,347 tokens/s.
The inventory of exposed devices covers high-end accelerators such as H100, H200, B200, and Blackwell Ultra B300, as well as consumer-grade GPUs including the RTX 4090 and RTX 5090.
Under the AI boom, NVIDIA's production capacity and distribution resources have been prioritized toward high-end models such as the H100 and H200.
Oracle has made massive investments in large-scale procurement of NVIDIA H100/H200 GPU clusters and bare-metal instance supply.
Nvidia's high-end GPUs include the H100, H200, and the Blackwell series.
AI companies are compelled to accept stringent long-term contract terms in order to secure scarce GPU resources, especially NVIDIA H100/H200 clusters.
The core upgrade of the H200 over the previous-generation H100 lies in VRAM capacity and bandwidth.
Converting to an 8-GPU full server basis, the equivalent H200 rental cost is approximately $35.20 per hour.
20 more timeline events
All Facts (20)
The retail price of a single NVIDIA H100/H200 GPU is as high as $30,000–$40,000.
90%VerifiedNVIDIA's H100/H200 series GPUs hold more than 80% of the AI training and inference market.
90%UnverifiedOpenAI、Google DeepMind、Anthropic等头部公司同时争夺有限的H100/H200 GPU供应
80%UnverifiedNVIDIA H100/H200 series GPUs have long been in a state of supply shortage.
70%UnverifiedBoth the NVIDIA H100/H200 and the AMD MI300X integrate HBM.
70%UnverifiedThe GPU generational progression from A100 to H100 and then to H200 has pushed the inference efficiency frontier outward with each new generation.
60%UnverifiedComposer 2.5的高速推理依赖推测性解码（Speculative Decoding）、KV Cache优化以及专用推理硬件（如H100/H200 GPU集群）的协同加速
60%UnverifiedIn GPU Index's price data snapshot, the lowest price for H100 is $1.37/hr (Vast.ai, spot instance), for H200 is $2.62/hr (CoreWeave, spot), for A100 is $1.15/hr (Paperspace, three-year contract), for L40S is $0.79/hr (RunPod, community cloud), and for B200 is $4.26/hr (CoreWeave, spot).
50%UnverifiedThese optimizations brought up to a 10% throughput improvement and up to a 9% improvement in time to first token (TTFT) on H200 GPUs.
50%UnverifiedJetBrains self-reported data: Mellum2.1 reaches 7,969 tokens/s on a single H200, while Qwen3.5-9B reaches 4,347 tokens/s.
50%UnverifiedThe inventory of exposed devices covers high-end accelerators such as H100, H200, B200, and Blackwell Ultra B300, as well as consumer-grade GPUs including the RTX 4090 and RTX 5090.
50%UnverifiedUnder the AI boom, NVIDIA's production capacity and distribution resources have been prioritized toward high-end models such as the H100 and H200.
50%UnverifiedOracle has made massive investments in large-scale procurement of NVIDIA H100/H200 GPU clusters and bare-metal instance supply.
50%UnverifiedNvidia's high-end GPUs include the H100, H200, and the Blackwell series.
50%UnverifiedAI companies are compelled to accept stringent long-term contract terms in order to secure scarce GPU resources, especially NVIDIA H100/H200 clusters.
50%UnverifiedThe core upgrade of the H200 over the previous-generation H100 lies in VRAM capacity and bandwidth.
50%UnverifiedJalapeño consumes approximately 700 watts, comparable to the H100 and H200, yet features nearly 3 times the memory capacity of the H100 and approximately 5 times the bandwidth.
50%UnverifiedIn Architect Mode, the agent's performance is on average 5.4% higher than the modeled H200 accelerator.
50%UnverifiedThe H200 is NVIDIA's high-end GPU for AI computing.
50%UnverifiedDemand for high-end GPUs such as the H100 and H200 from top AI labs and tech giants far exceeds the supply capacity of TSMC and NVIDIA.
50%