Unverified50% confidenceFactExact time
One on-demand H100 running full-time at $3.99/hour costs about $2913, equivalent to about 832,000 mid-tier batch reviewer calls or 16.6 million small batch calls.
1
Sources
50%
Confidence
Short-term (~14 days)
Relevance
10/16/2026
First Seen
Valid until: 10/30/2026
Sources
Related Entities
Related Claims
VerifiedThe price of a single NVIDIA H100 is approximately $30,000 to $40,000, and training a model of GPT-4's scale is estimated to require thousands of H100s running in parallel for several months.75% similarUnverified一块H100 GPU租用成本约每小时2-4美元，单卡每秒可生成约1000-3000个输出Token72% similarUnverifiedFor a Spot instance at $0.20/hour preempted 3 times per hour with a 70B model reloading for 4 minutes each time, the reload overhead is $0.04/hour and the effective rate is about $0.24/hour; but if preempted 10 times per hour, the effective rate rises to $0.33/hour.70% similarUnverifiedThe top 1% of paying AI users spend $903 per person per month, while the median user spends only $2569% similarUnverifiedThe model's key assumptions include: reviewer calls are 2000 input + 300 output tokens; system-under-test calls are 1500 input + 500 output tokens; a mid-tier model ($2/$10 per million tokens) is used by default; offline runs use the batch API for a 50% discount; online review uses standard pricing; human review is 4 minutes per case at $45 per hour; tooling costs follow Langfuse list prices; and the loaded cost of US full-time labor is $16188 per month.69% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1046448API
curl https://kongchang.com/api/v1/knowledge/claims/1046448MCP
get_claim(id=1046448)