NVIDIA A100 40GB vs NVIDIA A100 80GB
What each costs to rent by the hour across the providers we track — NVIDIA A100 40GB on 8 providers,NVIDIA A100 80GB on 13.
As of , the NVIDIA A100 80GB rents for a median $2.14 per GPU-hour on-demand versus $2.04 for the NVIDIA A100 40GB — $0.10 (5%) more for 100% more memory.
Side by side
| NVIDIA A100 40GB | NVIDIA A100 80GB | |
|---|---|---|
| Architecture | Ampere | Ampere |
| VRAM | 40 GB | 80 GB |
| Form factor | SXM | SXM |
| Median on-demand, per GPU-hour | $2.04 | $2.14 |
| Cheapest listed rate | $0.31 Google Cloud, spot, GPU only | $0.43 Google Cloud, spot, GPU only |
| Median per GB of VRAM, per hour | $0.051 | $0.027 |
| Providers listing it | 8 | 13 |
Providers that list both
| Provider | NVIDIA A100 40GB | NVIDIA A100 80GB | Premium |
|---|---|---|---|
| Jarvislabs | $0.89 | $1.49 | 67% |
| RunPod | $1.00 Community Cloud | $1.19 Community Cloud | 19% |
| DataCrunch | $1.29 | $1.79 | 39% |
| Lambda | $1.99 | $2.79 | 40% |
| Modal | $2.10 | $2.50 | 19% |
| Amazon Web Services | $2.74 us-east-1 | $3.43 us-east-1 | 25% |
| Google Cloud | $2.93 us-central1 | $3.93 us-central1 | 34% |
| Microsoft Azure | $3.40 westus2 | $3.67 eastus2 | 8% |
Medians are across on-demand rates only; the cheapest listed rate may be spot or a community tier and is labelled as such. Compare providers directly on the overview, or see each GPU's full table:NVIDIA A100 40GB, NVIDIA A100 80GB.
Data updated: