Skip to content
,

Why Are GPU Rental Prices Rising in 2026? H100, H200 and B200 Costs Explained

Cloud GPU rental prices went up in 2026 instead of down. The data behind the rise, from SemiAnalysis, Silicon Data and AWS, the reasons for it, and what it means for anyone renting H100, H200 or B200 GPUs.

4 min read

Why GPU Rental Prices Are Rising — cover image from TensorCore.si

Short answer

GPU rental prices rose through 2026 instead of falling as Blackwell arrived. SemiAnalysis's one-year H100 contract index climbed from $1.70 per GPU-hour in October 2025 to $2.35 in March 2026, nearly 40% in six months, and Silicon Data put H100 rentals at $2.82 by October 2026. AWS raised its GPU Capacity Block prices four times during the year. The main causes are booming inference demand, sold-out capacity, scarce Blackwell supply and higher memory costs. Track today's prices on our live GPU price tracker.

The numbers: how much GPU prices rose

IndicatorEarlierLaterChange
SemiAnalysis H100 one-year rental index$1.70 (Oct 2025)$2.35 (Mar 2026)about +38%
Silicon Data H100 rental index$2.37 (May 2025)$2.82 (Oct 2026)about +19%
Silicon Data B200 rental indexstart of 2026Sep 2026about +28% year to date
AWS Capacity Blocks (P5, P5en, P6)early 2026Oct 2026four increases of about 10% to 20% each

Silicon Data's indexes in October 2026 also put the H200 at about $3.43 per GPU-hour, the B200 at $5.93 and the B300 at $6.71. On-demand prices are higher: the median H100 price across the providers we track is about $3.92 per GPU-hour in November 2026.

Why GPU prices are going up

1. Inference demand exploded

Running AI models for users now uses far more compute than many expected. Reasoning models and AI agents generate many more tokens per request, and image and video generation added fresh demand in early 2026, according to SemiAnalysis. Unlike one-off training runs, inference demand is continuous.

2. Capacity is sold out

SemiAnalysis reported that on-demand capacity was sold out across GPU types, customers were reluctant to give up instances they held, some large providers stopped selling single nodes, and H100 contracts were being renewed at their original prices, some running into 2028.

3. Blackwell did not arrive fast enough

The common expectation was that new B200 and B300 GPUs would push older Hopper prices down. Instead, Blackwell supply stayed tight, with lead times stretching into mid-2026, so demand for H100 and H200 stayed strong. See Hopper vs Blackwell.

4. Memory and packaging costs rose

AI GPUs depend on HBM memory and advanced packaging. Samsung and SK hynix reportedly raised HBM3E prices by nearly 20% for 2026, and AI demand is also squeezing packaging, test and substrate capacity across the chip industry; read our report on the AI-driven chip shortage and our explainer on GDDR7 vs HBM.

5. Clouds passed costs on

AWS raised EC2 Capacity Block prices in January (about 15% for H200-based instances), April (about 10% in the US), July (about 20%) and October 2026 (about 15%, more outside the US). By October, published rates were about $5.97 per H100 GPU-hour and $14.21 per B200 GPU-hour for Capacity Blocks.

What it means for you

  • Do not assume prices will fall soon. Plan budgets with today's prices, not hoped-for discounts.
  • Lock in capacity when you find it. Teams with steady workloads are signing longer contracts to secure supply.
  • Shop around. On-demand H100 prices still range from about $1.80 to $11 per GPU-hour, so the provider you choose matters; see cheapest cloud GPU providers.
  • Use fewer GPUs. Quantization, smaller models and better batching cut costs whatever the price; see LLM quantization explained.
  • Consider owning if you have steady, high utilisation; the math is in rent vs buy a GPU.

Will GPU prices come down?

Possibly, but not quickly. Analysts point to three things to watch: how fast new Blackwell and Rubin clusters come online, whether the memory and chip supply squeeze worsens, and whether AI companies' revenue and token usage keep growing. Our tracker records prices every day, so you can see the direction yourself in the daily price history.

Frequently asked questions

How much does it cost to rent an H100 in 2026?

On-demand prices range from about $1.80 to $11 per GPU-hour, with a median of about $3.92 in November 2026. One-year contracts are lower, around $2.35 to $2.85. See the H100 price guide.

Why did GPU prices not drop after Blackwell launched?

Because demand, especially for inference, grew faster than new supply, and Blackwell availability was limited for much of 2026.

Are B200 prices rising too?

Yes. Silicon Data's B200 rental index rose about 28% in the first nine months of 2026. See the B200 price guide.

Sources and further reading

Think you understand it now? Prove it.

Solve real Tensor Core math in the TensorCore.si Challenge and earn a certificate with your name.

Take the challenge

Leave a Reply

Your email address will not be published. Required fields are marked *