Amazon Web Services vs Microsoft Azure
As of , Amazon Web Services lists the lower on-demand rate on 5 of the 7 GPUs both offer on-demand. On the priciest shared card both list on-demand, NVIDIA H200: Amazon Web Services $7.91 (us-east-1) vs Microsoft Azure $10.60 (westus2) per GPU-hour on-demand — Amazon Web Services is $2.69 (25%) cheaper.
On-demand, per GPU-hour
| GPU |  Amazon Web Services |  Microsoft Azure | Difference | Cheaper |
|---|---|---|---|---|
| NVIDIA H200 median $4.54 · 51 providers · lowest Beam $2.09 from | $7.91 us-east-1 captured Deploy ↗ | $10.60 westus2 captured Deploy ↗ | $2.69 (25%) | Amazon Web Services |
| NVIDIA H100 SXM median $3.52 · 38 providers · lowest Cudo Compute $1.79 GPU only | $6.88 us-east-1 captured Deploy ↗ | $11.06 eastus captured Deploy ↗ | $4.18 (38%) | Amazon Web Services |
| NVIDIA A100 80GB median $2.00 · 58 providers · lowest CloudRift $1.05 | $3.43 us-east-1 captured Deploy ↗ | $3.67 eastus2 captured Deploy ↗ | $0.24 (7%) | Amazon Web Services |
| NVIDIA RTX PRO 6000 Blackwell median $2.21 · 38 providers · lowest Hostinger $0.65 from | $3.36 us-east-1 captured Deploy ↗ | $5.50 eastus2 captured Deploy ↗ | $2.14 (39%) | Amazon Web Services |
| NVIDIA V100 median $2.48 · 11 providers · lowest Verda $0.23 | $3.06 us-east-1 captured Deploy ↗ | $3.06 eastus captured Deploy ↗ | — | Same |
| NVIDIA A100 40GB median $1.98 · 20 providers · lowest Trooper.AI $0.68 from | $2.74 us-east-1 captured Deploy ↗ | $3.40 westus2 captured Deploy ↗ | $0.65 (19%) | Amazon Web Services |
| NVIDIA T4 median $0.55 · 15 providers · lowest immers.cloud $0.24 | $0.53 us-east-1 captured Deploy ↗ | $0.53 northcentralus captured Deploy ↗ | — | Same |
Spot / interruptible, per GPU-hour
| GPU | Amazon Web Services | Microsoft Azure |
|---|---|---|
| NVIDIA H100 SXM | — | $2.04 captured |
| NVIDIA A100 80GB | — | $0.68 captured |
| NVIDIA RTX PRO 6000 Blackwell | — | $1.02 captured |
| NVIDIA V100 | — | $0.57 captured |
| NVIDIA A100 40GB | — | $0.75 captured |
| NVIDIA T4 | — | $0.07 captured |
How this is compared
Cloud GPU rental prices of Amazon Web Services and Microsoft Azure, compared per GPU-hour on the GPUs both list. Where a provider has several tiers or regions, its cheapest on-demand rate is used and labelled. Community capacity (RunPod Community Cloud) and marketplace floors are shown only where a provider has nothing else, and never decide which is cheaper.
GPU by GPU
- NVIDIA H200: Amazon Web Services $7.91 (us-east-1) vs Microsoft Azure $10.60 (westus2) per GPU-hour on-demand — Amazon Web Services is $2.69 (25%) cheaper.
- NVIDIA H100 SXM: Amazon Web Services $6.88 (us-east-1) vs Microsoft Azure $11.06 (eastus) per GPU-hour on-demand — Amazon Web Services is $4.18 (38%) cheaper.
- NVIDIA A100 80GB: Amazon Web Services $3.43 (us-east-1) vs Microsoft Azure $3.67 (eastus2) per GPU-hour on-demand — Amazon Web Services is $0.24 (7%) cheaper.
- NVIDIA RTX PRO 6000 Blackwell: Amazon Web Services $3.36 (us-east-1) vs Microsoft Azure $5.50 (eastus2) per GPU-hour on-demand — Amazon Web Services is $2.14 (39%) cheaper.
- NVIDIA V100: Amazon Web Services $3.06 (us-east-1) vs Microsoft Azure $3.06 (eastus) per GPU-hour on-demand — identical.
- NVIDIA A100 40GB: Amazon Web Services $2.74 (us-east-1) vs Microsoft Azure $3.40 (westus2) per GPU-hour on-demand — Amazon Web Services is $0.65 (19%) cheaper.
- NVIDIA T4: Amazon Web Services $0.53 (us-east-1) vs Microsoft Azure $0.53 (northcentralus) per GPU-hour on-demand — identical.
Not compared: GPUs only one of the two lists, reserved/committed tiers, and anything either provider prices only on request. See each provider's page for its full list.
Data updated: