Short answer
GPU rental prices rose through 2026 instead of falling as Blackwell arrived. SemiAnalysis's one-year H100 contract index climbed from $1.70 per GPU-hour in October 2025 to $2.35 in March 2026, nearly 40% in six months, and Silicon Data put H100 rentals at $2.82 by October 2026. AWS raised its GPU Capacity Block prices four times during the year. The main causes are booming inference demand, sold-out capacity, scarce Blackwell supply and higher memory costs. Track today's prices on our live GPU price tracker.
The numbers: how much GPU prices rose
| Indicator | Earlier | Later | Change |
|---|---|---|---|
| SemiAnalysis H100 one-year rental index | $1.70 (Oct 2025) | $2.35 (Mar 2026) | about +38% |
| Silicon Data H100 rental index | $2.37 (May 2025) | $2.82 (Oct 2026) | about +19% |
| Silicon Data B200 rental index | start of 2026 | Sep 2026 | about +28% year to date |
| AWS Capacity Blocks (P5, P5en, P6) | early 2026 | Oct 2026 | four increases of about 10% to 20% each |
Silicon Data's indexes in October 2026 also put the H200 at about $3.43 per GPU-hour, the B200 at $5.93 and the B300 at $6.71. On-demand prices are higher: the median H100 price across the providers we track is about $3.92 per GPU-hour in November 2026.
Why GPU prices are going up
1. Inference demand exploded
Running AI models for users now uses far more compute than many expected. Reasoning models and AI agents generate many more tokens per request, and image and video generation added fresh demand in early 2026, according to SemiAnalysis. Unlike one-off training runs, inference demand is continuous.
2. Capacity is sold out
SemiAnalysis reported that on-demand capacity was sold out across GPU types, customers were reluctant to give up instances they held, some large providers stopped selling single nodes, and H100 contracts were being renewed at their original prices, some running into 2028.
3. Blackwell did not arrive fast enough
The common expectation was that new B200 and B300 GPUs would push older Hopper prices down. Instead, Blackwell supply stayed tight, with lead times stretching into mid-2026, so demand for H100 and H200 stayed strong. See Hopper vs Blackwell.
4. Memory and packaging costs rose
AI GPUs depend on HBM memory and advanced packaging. Samsung and SK hynix reportedly raised HBM3E prices by nearly 20% for 2026, and AI demand is also squeezing packaging, test and substrate capacity across the chip industry; read our report on the AI-driven chip shortage and our explainer on GDDR7 vs HBM.
5. Clouds passed costs on
AWS raised EC2 Capacity Block prices in January (about 15% for H200-based instances), April (about 10% in the US), July (about 20%) and October 2026 (about 15%, more outside the US). By October, published rates were about $5.97 per H100 GPU-hour and $14.21 per B200 GPU-hour for Capacity Blocks.
What it means for you
- Do not assume prices will fall soon. Plan budgets with today's prices, not hoped-for discounts.
- Lock in capacity when you find it. Teams with steady workloads are signing longer contracts to secure supply.
- Shop around. On-demand H100 prices still range from about $1.80 to $11 per GPU-hour, so the provider you choose matters; see cheapest cloud GPU providers.
- Use fewer GPUs. Quantization, smaller models and better batching cut costs whatever the price; see LLM quantization explained.
- Consider owning if you have steady, high utilisation; the math is in rent vs buy a GPU.
Will GPU prices come down?
Possibly, but not quickly. Analysts point to three things to watch: how fast new Blackwell and Rubin clusters come online, whether the memory and chip supply squeeze worsens, and whether AI companies' revenue and token usage keep growing. Our tracker records prices every day, so you can see the direction yourself in the daily price history.
Frequently asked questions
How much does it cost to rent an H100 in 2026?
On-demand prices range from about $1.80 to $11 per GPU-hour, with a median of about $3.92 in November 2026. One-year contracts are lower, around $2.35 to $2.85. See the H100 price guide.
Why did GPU prices not drop after Blackwell launched?
Because demand, especially for inference, grew faster than new supply, and Blackwell availability was limited for much of 2026.
Are B200 prices rising too?
Yes. Silicon Data's B200 rental index rose about 28% in the first nine months of 2026. See the B200 price guide.
Sources and further reading
- SemiAnalysis, The Great GPU Shortage: H100 rental price index
- Tiger Brokers, Nvidia H100 GPU rental costs jump nearly 40% over six months (April 2026)
- IntuitionLabs, NVIDIA AI GPU pricing guide (citing Silicon Data and TrendForce)
- eCorp IT, AWS raised GPU Capacity Block prices in 2026
- TensorCore.si, Live GPU cloud pricing tracker (updated daily)




Leave a Reply