NVIDIA H100 SXM vs NVIDIA H200
What each costs to rent by the hour across the providers we track — NVIDIA H100 SXM on 16 providers,NVIDIA H200 on 14.
As of , the NVIDIA H200 rents for a median $4.54 per GPU-hour on-demand versus $3.85 for the NVIDIA H100 SXM — $0.69 (15%) more for 76% more memory.
Side by side
| NVIDIA H100 SXM | NVIDIA H200 | |
|---|---|---|
| Architecture | Hopper | Hopper |
| VRAM | 80 GB | 141 GB |
| Form factor | SXM | SXM |
| Median on-demand, per GPU-hour | $3.85 | $4.54 |
| Cheapest listed rate | $1.06 Google Cloud, spot, GPU only | $2.00 DataCrunch, spot |
| Median per GB of VRAM, per hour | $0.048 | $0.032 |
| Providers listing it | 16 | 14 |
Providers that list both
| Provider | NVIDIA H100 SXM | NVIDIA H200 | Premium |
|---|---|---|---|
| GMI Cloud | $2.00 | $2.60 | 30% |
| Vast.ai | $2.41 | $3.98 | 65% |
| RunPod | $2.69 Community Cloud | $3.59 Community Cloud | 33% |
| Jarvislabs | $2.69 | $3.99 | 48% |
| Hyperstack | $3.20 | $3.99 | 25% |
| DataCrunch | $3.25 | $4.00 | 23% |
| Nebius | $3.85 | $4.50 | 17% |
| Modal | $3.95 | $4.54 | 15% |
| Together AI | $3.99 | $5.99 | 50% |
| CoreWeave | $6.16 | $6.30 | 2% |
| Amazon Web Services | $6.88 us-east-1 | $7.91 us-east-1 | 15% |
| Google Cloud | $9.80 us-west8 | $9.31 us-west1 | 5% |
| Oracle Cloud (OCI) | $10.00 | $10.00 | 0% |
| Microsoft Azure | $11.06 eastus | $10.60 westus2 | 4% |
Medians are across on-demand rates only; the cheapest listed rate may be spot or a community tier and is labelled as such. Compare providers directly on the overview, or see each GPU's full table:NVIDIA H100 SXM, NVIDIA H200.
Data updated: