Rental costs for Nvidia’s H200 GPUs have increased by approximately 160% between January 1, 2026, and mid-October 2026. This significant price increase for the high-performance AI accelerator suggests that demand for AI computing power is currently outpacing supply.
The H200’s price hike is the most dramatic among Nvidia’s offerings, but other models have also seen rental costs rise since the start of the year. The Nvidia B200’s rental costs have increased by about 120%, and the Nvidia RTX PRO 6000 by around 65%. The Nvidia H100, a predecessor to the H200, has experienced a more modest increase of approximately 35% in rental costs during the same period. Notably, even the six-year-old Nvidia A100 is now renting for more than it did in January 2026.
These price increases across multiple Nvidia GPU models signal a broader market trend of rising costs for AI computing resources. The H200’s substantial price jump is partly attributed to its advanced capabilities, including 141 GB of HBM3e memory—1.76 times that of the H100—and 4.8 TB/s of memory bandwidth.
The rental market for these GPUs varies by service model. Median on-demand rental prices for the H200 typically range from $4.27 to $4.94 per GPU-hour across providers. Spot marketplaces offer lower rates, with H200 prices sometimes falling as low as $1.47 per GPU-hour and reaching up to $3.88. In contrast, hyperscalers like AWS and Azure command higher rates, with H200 rental prices averaging between $7.91 and over $10.60 per hour.
Individual providers are also adjusting their pricing to reflect market conditions. Nebius, for example, increased its on-demand H200 price from $4.50 to $5.40 per GPU-hour, a 20% rise. Nebius also raised H100 rates by 17% on October 1, 2026.
The current situation highlights a significant imbalance where the demand for AI computing power, driven by increasing adoption of artificial intelligence across industries, is not being met by the available supply of high-performance GPUs. While the exact supply levels of Nvidia GPUs remain uncertain, the consistent price increases across its product line indicate a constrained market.
Why This Matters
The materials describe a narrow update: Rental prices for Nvidia H200 GPUs have increased by approximately 160% from January 1, 2026, to mid-October 2026, indicating high demand for AI computing power that outstrips supply. The exact supply levels of Nvidia GPUs.
Broader Context
Source materials place the factual news in this context: The H200 isn’t the only Nvidia chip getting more expensive to rent. It is simply getting more expensive faster than the rest of the lineup.
