A100, H100, H200, B200, B300: which GPU should you pick?
Pick by your bottleneck. At Nodus list prices the B200 buys BF16 math cheapest, the A100 buys memory cheapest, and the H200 and B300 sell headroom.
Pick by your bottleneck. At Nodus list prices the B200 buys BF16 math cheapest, the A100 buys memory cheapest, and the H200 and B300 sell headroom.
B200 vs H200: 1.28x the memory, 1.67x the bandwidth and 2.27x the FP8 math for 1.53x the price on Nodus. The B200 wins once it is kept busy.
B200 vs H100 for training: MLPerf shows 2.04x to 2.08x faster at equal GPU count. On Nodus a B200 must be 2.115x faster to cost less per run.
NVIDIA B200 price: $5.50 to $7.99 per GPU-hour on demand, or $591,114.20 for an 8-GPU DGX B200. Buying beats Nodus above about 60% utilization.
One GPU for most fine-tunes, 8 or more for full training of large models and pretraining. Size it with two floors: memory to fit and GPU-hours to finish.
B300 vs B200 for training: 288 GB vs 180 GB and faster FP4, but the same BF16 and FP8 math. A B300 must be 1.26x faster to cost less on Nodus.
Sticker price per GPU-hour vs cost per finished job on H100 and B200: startup, idle time, redone work, storage and egress, with a worked 8-GPU example.
Listed per GPU-hour prices for B300, B200, H200, H100, A100, L40S, L4 and RTX cards as of October 8, 2026, with a training-run cost example.