DEV Community

Viswaretas Kotra
Viswaretas Kotra

Posted on

GPU cloud pricing, October 2026: what an H100, H200, B200 or B300 costs per hour

Short answer (Oct 8, 2026): on Nodus, an H100 SXM 80 GB is $2.60/hr, H200 SXM $3.59/hr, B200 $5.50/hr and B300 $6.94/hr on demand. Consumer and prosumer cards go much lower: an RTX 4090 is $0.29/hr and an RTX 3090 is $0.18/hr. Modal's listed rates for the same data center GPUs run from 2% higher (B300) to about 2.5x higher (L40S) depending on the card.

Prices below are per GPU-hour, USD, taken from the public Nodus pricing page on October 8, 2026, which lists Modal's published rate beside each one.

Data center GPUs

GPU VRAM Nodus Modal
B300 288 GB $6.943 $7.099
B200 180 GB $5.500 $6.250
H200 SXM 141 GB $3.593 $4.540
H100 SXM 80 GB $2.600 $3.949
A100 80 GB $1.090 $2.498
A100 40 GB $0.904 $2.099
RTX PRO 6000 96 GB $1.350 $3.031
L40S 48 GB $0.793 $1.951
L4 24 GB $0.430 $0.799

Budget and prosumer GPUs

GPU VRAM Nodus
RTX 5090 32 GB $0.480
RTX 4090 24 GB $0.290
RTX 3090 24 GB $0.180
RTX 6000 Ada 48 GB $0.743
RTX A6000 48 GB $0.333
RTX A4000 16 GB $0.173

Which one should you rent?

  • Fine-tuning a 7B to 14B model with LoRA: a 48 GB card (L40S, A6000) or a 24 GB card with QLoRA. A100 80 GB if you want full fine-tunes of small models.
  • Full fine-tunes and pretraining at scale: H100 or H200. H200's 141 GB helps with long context and larger batch sizes.
  • Serving frontier-size open models: B200 or B300. B300's 288 GB per GPU means fewer GPUs per replica, which often lowers cost per token even though the hourly rate is higher.
  • Experiments, evals and small jobs: RTX 4090 / 5090 at under $0.50/hr are hard to beat.

What the hourly rate does not tell you

  1. Boot and teardown. Some platforms bill from machine creation to deletion. On Nodus the bill is split into Boot, Running and Teardown segments so you can see it.
  2. Price changes mid-run. Nodus freezes the rate when the machine is chosen for the whole run.
  3. Interruptions. Spot capacity is cheaper, but only if your job checkpoints. Otherwise one preemption can wipe out the savings. See our preemption guide.
  4. Reserved terms. For multi-month commitments on B200/B300, reserved pricing is quoted separately and depends on term length, location and interconnect. Nodus handles these through Reserved Compute.

FAQ

What is the cheapest H100 per hour in October 2026? On Nodus, $2.60/hr for an H100 SXM 80 GB, on demand.

How much does a B300 cost per hour? $6.94/hr on demand on Nodus as of Oct 8, 2026. Reserved terms are quoted per request.

Is there a free tier? New Nodus accounts get a $30 starter grant valid for 30 days.

We refresh this table monthly. Live prices: nodus-compute.ai/pricing

Top comments (0)