Microsoft Azure · NVIDIA A100 40GB
A100 40GB on Microsoft Azure
As of , Microsoft Azure lists the NVIDIA A100 40GB from $3.40 per GPU-hour on-demand (westus2), read . Among the 19 providers we track with an on-demand rate for this card, that is #19; the median rate card is $1.99, so Microsoft Azure is 71% above it. The cheapest is $0.76 on centron. Microsoft Azure’s cheapest rate of any market is $0.75 (spot, westus2), capacity that can be taken back or shared, so it is not ranked as on-demand.
Microsoft Azure’s A100 40GB rates
On-demand
| GPU · what is sold | $ / GPU-hour | Read | Source |
|---|---|---|---|
| Standard_ND96asr_A100_v4API$27.20/node ÷ 8 · westus2 | $3.40 | captured | Deploy ↗ |
Spot / interruptible
| GPU · what is sold | $ / GPU-hour | Read | Source |
|---|---|---|---|
| Standard_ND96asr_A100_v4API$5.98/node ÷ 8 · westus2 · −$2.65 (−78%) vs its on-demand $3.40 | $0.75 | captured | Deploy ↗ |
Reserved (committed use)
| GPU · what is sold | $ / GPU-hour | Read | Source |
|---|---|---|---|
| Standard_ND96asr_A100_v4API3-year · $10.88/node ÷ 8 · westus2 · min. commitment 3yr · −$2.04 (−60%) vs its on-demand $3.40 | $1.36 | captured | Reserve ↗ |
| Standard_ND96asr_A100_v4API1-year · $18.83/node ÷ 8 · westus2 · min. commitment 1yr · −$1.05 (−31%) vs its on-demand $3.40 | $2.35 | captured | Reserve ↗ |
Providers near this rate
Each provider’s cheapest live on-demand rate for the NVIDIA A100 40GB, Microsoft Azure among them, 6 of 19. The full list is on the NVIDIA A100 40GB page.
| Place | Provider | USD / GPU-hour | Read | Deploy |
|---|---|---|---|---|
| #1 | $0.76 | captured | Deploy ↗ | |
| #15 | $2.93 | captured | Deploy ↗ | |
| #16 | $3.02 | captured | Deploy ↗ | |
| #17 | $3.05 | captured | Deploy ↗ | |
| #18 | $3.09 | captured | Deploy ↗ | |
| #19 | $3.40 | captured | Deploy ↗ |
More: every NVIDIA A100 40GB rate at every provider on the NVIDIA A100 40GB page (price history) · every card at Microsoft Azure on Microsoft Azure’s page · Microsoft Azure vs centron, card by card. This page as data: /providers/azure/prices.json.
Data updated: