GPUs for training

As of October 10, 2026 — Cards with 80 GB or more: from $0.65 per GPU-hour on the NVIDIA RTX PRO 6000 Blackwell (Hostinger), 18 cards qualify. Rates are each card’s cheapest live on-demand rate card across the providers we track, read hourly, every one linked to the page it was read from.

Training a model from scratch spreads its weights, gradients and optimizer states - 16 bytes per parameter in mixed precision with Adam - over many GPUs, so the card is chosen for its memory and for the links between cards in a node, not for fitting the model alone; interconnect is not ranked here. Below, every card with 80 GB or more; each card page lists the providers that price a whole 8-GPU node.

Cards with 80 GB or more

A 7B model alone takes 7 billion × 16 bytes = 112 GB of training state, more than one 80 GB card holds: training is split across cards from the start.

Cards with 80 GB or more: cards with 80 GB or more, cheapest first, as of October 10, 2026.
Card, memory	Cheapest on-demand	Provider, read	Median rate card	$ per GB-hour	Deploy
NVIDIA RTX PRO 6000 Blackwell · 96 GB	$0.65 from	Hostinger captured Oct 10, 22:39 UTC	$2.20 35 providers	$0.007	Deploy ↗
NVIDIA A100 80GB · 80 GB	$0.89	Deep Infra captured Oct 10, 22:39 UTC	$1.89 53 providers	$0.011	Deploy ↗
AMD Instinct MI300X · 192 GB	$1.71 from	TensorWave captured Oct 10, 22:39 UTC	$2.81 8 providers	$0.009	Deploy ↗
NVIDIA H100 80GB (form factor not stated) · 80 GB	$1.71	Gcore captured Oct 10, 22:39 UTC	$3.44 22 providers	$0.021	Deploy ↗
NVIDIA H100 SXM · 80 GB	$1.79 GPU only	Cudo Compute captured Oct 10, 22:39 UTC	$3.55 33 providers	$0.022	Deploy ↗
NVIDIA RTX PRO 6000 Blackwell Max-Q · 96 GB	$1.80	EmpirioLabs captured Oct 10, 22:39 UTC	$1.86 2 providers	$0.019	Deploy ↗
NVIDIA H100 PCIe · 80 GB	$1.83 from	Beam captured Oct 10, 22:39 UTC	$2.82 10 providers	$0.023	Deploy ↗
NVIDIA H200 · 141 GB	$2.09 from	Beam captured Oct 10, 22:39 UTC	$4.54 45 providers	$0.015	Deploy ↗
AMD Instinct MI325X · 256 GB	$2.25	Bentaus captured Oct 10, 22:39 UTC	$2.25 3 providers	$0.009	Deploy ↗
NVIDIA GH200 · 96 GB	$2.29	Lambda captured Oct 10, 22:39 UTC	$3.87 3 providers	$0.024	Deploy ↗

8 more cards qualify, dearer: NVIDIA H100 NVL $2.92, AMD Instinct MI355X $2.95, NVIDIA H200 NVL $3.29, NVIDIA B200 $3.69, AMD Instinct MI350X $4.00, NVIDIA B300 $4.89, NVIDIA GB200 NVL72 $6.94, NVIDIA GB300 NVL72 $10.74.

How these figures are read

A card qualifies by its memory alone; speed, interconnect and software support are not ranked here. The rate is the card’s cheapest live on-demand rate card - each provider once, at its cheapest on-demand rate, community capacity and marketplace floors out, read within 48 hours - and the median is taken over the same rate cards, as on every card page. Memory figures are floors from the arithmetic above, not measurements: context length, batch size and the serving stack change them. Methodology.

Sources

Rajbhandari et al., ZeRO: Memory Optimizations Toward Training Trillion Parameter Models (2019)

Other workloads: GPUs for LLM inference · GPUs for fine-tuning · GPUs for image generation · Cheapest GPU memory per hour.

Data updated: October 10, 2026