Skip to content

Cloud GPU pricing, October 2026: what an H100, H200, B200 or B300 costs per hour

Listed per GPU-hour prices for B300, B200, H200, H100, A100, L40S, L4 and RTX cards as of October 8, 2026, with a training-run cost example.

Short answer (Oct 8, 2026): the Nodus pricing page lists an H100 SXM 80 GB at $2.60/hr, H200 SXM at $3.59/hr, B200 at $5.50/hr and B300 at $6.94/hr. Consumer and prosumer cards go much lower: an RTX 4090 is $0.29/hr and an RTX 3090 is $0.18/hr. Modal’s listed rates for the same data center GPUs run from 2% higher (B300) to about 2.5x higher (L40S) depending on the card.

Prices below are per GPU-hour, USD, taken from the public Nodus pricing page on October 8, 2026, which lists Modal’s published rate beside each one.

GPU VRAM Nodus Modal
B300 288 GB $6.943 $7.099
B200 180 GB $5.500 $6.250
H200 SXM 141 GB $3.593 $4.540
H100 SXM 80 GB $2.600 $3.949
A100 80 GB $1.090 $2.498
A100 40 GB $0.904 $2.099
RTX PRO 6000 96 GB $1.350 $3.031
L40S 48 GB $0.793 $1.951
L4 24 GB $0.430 $0.799
GPU VRAM Nodus
RTX 5090 32 GB $0.480
RTX 4090 24 GB $0.290
RTX 3090 24 GB $0.180
RTX 6000 Ada 48 GB $0.743
RTX A6000 48 GB $0.333
RTX A4000 16 GB $0.173
  • Fine-tuning a 7B to 14B model with LoRA: a 48 GB card (L40S, A6000) or a 24 GB card with QLoRA. A100 80 GB if you want full fine-tunes of small models.
  • Full fine-tunes and pretraining at scale: H100 or H200. H200’s 141 GB helps with long context and larger batch sizes.
  • Serving frontier-size open models: B200 or B300. B300’s 288 GB per GPU means fewer GPUs per replica, which often lowers cost per token even though the hourly rate is higher.
  • Experiments, evals and small jobs: RTX 4090 / 5090 at under $0.50/hr are hard to beat.
  1. Boot and teardown. Some platforms bill from machine creation to deletion. On Nodus the bill is split into Boot, Running and Teardown segments so you can see it.
  2. Price changes mid-run. Nodus freezes the rate when the machine is chosen for the whole run.
  3. Interruptions. Spot capacity is cheaper, but only if your job checkpoints. Otherwise one preemption can wipe out the savings. See our preemption guide.
  4. Reserved terms. For multi-month commitments on B200/B300, reserved pricing is quoted separately and depends on term length, location and interconnect. Nodus handles these through Reserved Compute.

What is the cheapest H100 per hour in October 2026? The Nodus pricing page lists an H100 SXM 80 GB at $2.60/hr as of Oct 8, 2026. Run nodus run --dry-run for the estimate for your exact job.

How much does a B300 cost per hour? The Nodus pricing page lists a B300 at $6.94/hr as of Oct 8, 2026. Reserved terms are quoted per request.

Is there a free tier? New Nodus accounts get a $30 starter grant valid for 30 days.

We refresh this table monthly. Live prices: nodus-compute.ai/pricing

More from the blog