Skip to content
ZeroCloudBill
Guide

AI infrastructure costs in 2026.

For most LLM teams, GPU compute dominates the cloud bill. Knowing the spread between providers — and how to optimize across identical hardware — matters more than ever.

The price spread is huge.

An NVIDIA H100 costs $1.89/hr at the cheapest provider in our directory and $6.98/hr at the most expensive. That's a 269% delta for identical silicon.

A typical training run.

A 7B model fine-tune on 8× H100 for one week of compute lands between $2540.16 and $9381.12, depending on the cloud. For most teams, that single decision is the largest fixed cost in the project.

Why identical-hardware matching matters.

ZeroCloudBill's optimizer never suggests dropping from H100 to L40S, or A100 to RTX 4090. Identical chip = identical training behavior. Anything else is a configuration change that should require an experiment, not a billing decision.

Per-class cost summary

H100
Cheapest monthly (730h)
$1,380
Range
$1.89 – $6.98/hr
L40S
Cheapest monthly (730h)
$402
Range
$0.55 – $1.86/hr
B300
Cheapest monthly (730h)
$4,088
Range
$5.60 – $17.80/hr
RTX-5090
Cheapest monthly (730h)
$212
Range
$0.29 – $0.99/hr
RTX-4080
Cheapest monthly (730h)
$95
Range
$0.13 – $0.28/hr
RTX-6000-ADA
Cheapest monthly (730h)
$350
Range
$0.48 – $1.57/hr
RTX-4090
Cheapest monthly (730h)
$146
Range
$0.20 – $0.66/hr
B200
Cheapest monthly (730h)
$2,336
Range
$3.20 – $8.19/hr
RTX-3090
Cheapest monthly (730h)
$51
Range
$0.07 – $0.50/hr
A6000
Cheapest monthly (730h)
$255
Range
$0.35 – $1.09/hr
A100
Cheapest monthly (730h)
$639
Range
$0.88 – $4.03/hr
RTX-PRO-6000
Cheapest monthly (730h)
$482
Range
$0.66 – $5.50/hr
V100
Cheapest monthly (730h)
$168
Range
$0.23 – $3.06/hr
A5000
Cheapest monthly (730h)
$80
Range
$0.11 – $1.56/hr
H200
Cheapest monthly (730h)
$1,679
Range
$2.30 – $7.91/hr
A4000
Cheapest monthly (730h)
$58
Range
$0.08 – $0.88/hr
L40
Cheapest monthly (730h)
$343
Range
$0.47 – $1.09/hr
RTX-5060-TI
Cheapest monthly (730h)
$37
Range
$0.05 – $0.18/hr
A10
Cheapest monthly (730h)
$146
Range
$0.20 – $3.20/hr
MI300X
Cheapest monthly (730h)
$1,059
Range
$1.45 – $6.00/hr
RTX-3080
Cheapest monthly (730h)
$23
Range
$0.03 – $0.25/hr
A30
Cheapest monthly (730h)
$255
Range
$0.35 – $1.23/hr
RTX-3070
Cheapest monthly (730h)
$51
Range
$0.07 – $0.13/hr
RTX-3060
Cheapest monthly (730h)
$30
Range
$0.04 – $0.11/hr
RTX-2080-TI
Cheapest monthly (730h)
$44
Range
$0.06 – $0.33/hr
L4
Cheapest monthly (730h)
$358
Range
$0.49 – $2.30/hr
MI325X
Cheapest monthly (730h)
$1,146
Range
$1.57 – $3.80/hr
RTX-4060
Cheapest monthly (730h)
$20
Range
$0.03 – $0.21/hr
RTX-5080
Cheapest monthly (730h)
$66
Range
$0.09 – $0.39/hr
RTX-4000-ADA
Cheapest monthly (730h)
$117
Range
$0.16 – $0.76/hr
P100
Cheapest monthly (730h)
$88
Range
$0.12 – $1.87/hr
RTX-3080-TI
Cheapest monthly (730h)
$27
Range
$0.04 – $0.92/hr
GB300
Cheapest monthly (730h)
$3,146
Range
$4.31 – $18.00/hr
RTX-PRO-4000
Cheapest monthly (730h)
$51
Range
$0.07 – $0.57/hr
A40
Cheapest monthly (730h)
$321
Range
$0.44 – $2.05/hr
RTX-4070-TI
Cheapest monthly (730h)
$66
Range
$0.09 – $0.19/hr
T4
Cheapest monthly (730h)
$146
Range
$0.20 – $2.13/hr
RTX-PRO-4500
Cheapest monthly (730h)
$190
Range
$0.26 – $3.56/hr
RTX-4070
Cheapest monthly (730h)
$31
Range
$0.04 – $0.09/hr
RTX-4060-TI
Cheapest monthly (730h)
$44
Range
$0.06 – $0.20/hr
GAUDI2
Cheapest monthly (730h)
$453
Range
$0.62 – $1.21/hr
RTX-2060
Cheapest monthly (730h)
$29
Range
$0.04 – $0.22/hr
RTX-3060-TI
Cheapest monthly (730h)
$31
Range
$0.04 – $0.25/hr
RTX-PRO-5000
Cheapest monthly (730h)
$102
Range
$0.14 – $0.96/hr
RTX-5070-TI
Cheapest monthly (730h)
$58
Range
$0.08 – $0.29/hr
A16
Cheapest monthly (730h)
$95
Range
$0.13 – $0.56/hr
RTX-3090-TI
Cheapest monthly (730h)
$102
Range
$0.14 – $0.27/hr
GTX-1080
Cheapest monthly (730h)
$29
Range
$0.04 – $0.05/hr
GTX-1070-TI
Cheapest monthly (730h)
$29
Range
$0.04 – $0.05/hr
RTX-6000
Cheapest monthly (730h)
$95
Range
$0.13 – $1.50/hr
GTX-1660
Cheapest monthly (730h)
$30
Range
$0.04 – $0.19/hr
P4
Cheapest monthly (730h)
$168
Range
$0.23 – $1.17/hr
RTX-5070
Cheapest monthly (730h)
$28
Range
$0.04 – $0.27/hr
RADEON-PRO-V520
Cheapest monthly (730h)
$139
Range
$0.19 – $0.87/hr
GB200
Cheapest monthly (730h)
$1,913
Range
$2.62 – $27.04/hr
GTX-1080-TI
Cheapest monthly (730h)
$30
Range
$0.04 – $0.06/hr
A2000
Cheapest monthly (730h)
$21
Range
$0.03 – $0.07/hr
RTX-5880-ADA
Cheapest monthly (730h)
$197
Range
$0.27 – $0.42/hr
A10G
Cheapest monthly (730h)
$314
Range
$0.43 – $1.97/hr
K80
Cheapest monthly (730h)
$33
Range
$0.04 – $0.90/hr
RTX-5000-ADA
Cheapest monthly (730h)
$197
Range
$0.27 – $0.49/hr
RTX-2070
Cheapest monthly (730h)
$30
Range
$0.04 – $0.12/hr
T4G
Cheapest monthly (730h)
$168
Range
$0.23 – $1.37/hr
RTX-5060
Cheapest monthly (730h)
$44
Range
$0.06 – $0.12/hr
RTX-PRO-6000D
Cheapest monthly (730h)
$599
Range
$0.82 – $0.82/hr
A800
Cheapest monthly (730h)
$679
Range
$0.93 – $0.93/hr
RTX-5000
Cheapest monthly (730h)
$438
Range
$0.60 – $0.82/hr
M60
Cheapest monthly (730h)
$548
Range
$0.75 – $1.14/hr
GH200
Cheapest monthly (730h)
$1,453
Range
$1.99 – $6.50/hr
A4500
Cheapest monthly (730h)
$139
Range
$0.19 – $0.25/hr
RTX-2000-ADA
Cheapest monthly (730h)
$175
Range
$0.24 – $0.26/hr
V100S
Cheapest monthly (730h)
$642
Range
$0.88 – $0.88/hr
GTX-1070
Cheapest monthly (730h)
$32
Range
$0.04 – $0.53/hr
RTX-2080
Cheapest monthly (730h)
$51
Range
$0.07 – $0.74/hr
P600
Cheapest monthly (730h)
$51
Range
$0.07 – $0.08/hr
P1000
Cheapest monthly (730h)
$66
Range
$0.09 – $0.10/hr
GTX-1650
Cheapest monthly (730h)
$32
Range
$0.04 – $0.14/hr
T1000
Cheapest monthly (730h)
$102
Range
$0.14 – $0.16/hr
MI355X
Cheapest monthly (730h)
$1,891
Range
$2.59 – $8.60/hr
GTX-1660-SUPER
Cheapest monthly (730h)
$32
Range
$0.04 – $0.07/hr
RTX-3070-TI
Cheapest monthly (730h)
$66
Range
$0.09 – $0.20/hr
MI250
Cheapest monthly (730h)
$949
Range
$1.30 – $1.30/hr
GT730|P600|K620
Cheapest monthly (730h)
$25
Range
$0.03 – $0.03/hr
RTX 5060
Cheapest monthly (730h)
$99
Range
$0.14 – $0.14/hr
RTX-PRO-2000
Cheapest monthly (730h)
$102
Range
$0.14 – $0.14/hr
GTX 1650
Cheapest monthly (730h)
$119
Range
$0.16 – $0.16/hr
RTX PRO 2000
Cheapest monthly (730h)
$119
Range
$0.16 – $0.16/hr
RTX A4000
Cheapest monthly (730h)
$149
Range
$0.20 – $0.20/hr
GTX 1660
Cheapest monthly (730h)
$159
Range
$0.22 – $0.22/hr
RTX 4060
Cheapest monthly (730h)
$179
Range
$0.25 – $0.25/hr
RTX 2060
Cheapest monthly (730h)
$199
Range
$0.27 – $0.27/hr
RTX 3060 TI
Cheapest monthly (730h)
$239
Range
$0.33 – $0.33/hr
RTX A5000
Cheapest monthly (730h)
$255
Range
$0.35 – $0.35/hr
RTX A6000
Cheapest monthly (730h)
$439
Range
$0.60 – $0.60/hr
RTX 5090
Cheapest monthly (730h)
$449
Range
$0.62 – $0.62/hr
RTX 4090
Cheapest monthly (730h)
$549
Range
$0.75 – $0.75/hr
3 X V100
Cheapest monthly (730h)
$599
Range
$0.82 – $0.82/hr
3 X RTX A5000
Cheapest monthly (730h)
$699
Range
$0.96 – $0.96/hr
2 X RTX 4090
Cheapest monthly (730h)
$719
Range
$0.99 – $0.99/hr
2 X RTX 5090
Cheapest monthly (730h)
$1,099
Range
$1.51 – $1.51/hr
3 X RTX A6000
Cheapest monthly (730h)
$1,199
Range
$1.64 – $1.64/hr
4 X RTX A6000
Cheapest monthly (730h)
$1,599
Range
$2.19 – $2.19/hr
A100(80GB)
Cheapest monthly (730h)
$1,699
Range
$2.33 – $2.33/hr
4 X A100
Cheapest monthly (730h)
$2,499
Range
$3.42 – $3.42/hr
M4000
Cheapest monthly (730h)
$329
Range
$0.45 – $0.45/hr
P4000
Cheapest monthly (730h)
$372
Range
$0.51 – $0.51/hr
P5000
Cheapest monthly (730h)
$569
Range
$0.78 – $0.78/hr
P6000
Cheapest monthly (730h)
$803
Range
$1.10 – $1.10/hr
GTX-1050-TI
Cheapest monthly (730h)
$25
Range
$0.03 – $0.03/hr
GTX-1060
Cheapest monthly (730h)
$32
Range
$0.04 – $0.04/hr
RTX-3050
Cheapest monthly (730h)
$37
Range
$0.05 – $0.05/hr
RTX-4070-TI-SUPER
Cheapest monthly (730h)
$80
Range
$0.11 – $0.11/hr