GPUs Ranked by Cost per FP32 TFLOPs
Something missing? Let us know and we'll add it if we can.
GPU | $ / FP32 TFLOPs | $ / FP16 TFLOPs | $ / Tensor Core Count | $ / Memory Capacity (GB) | $ / Memory Bandwidth (GB/s) | $ / Int8 TOPs | Minimum Price | Available for Sale |
---|---|---|---|---|---|---|---|---|
NVIDIA T4 16GB | $61.60 | $7.68 | $1.56 | $31.19 | $1.56 | $3.84 | $499 | 77 |
NVIDIA A30 24GB | $20.91 | $20.91 | $15.40 | $143.75 | $3.70 | $10.45 | $3,450 | 35 |
NVIDIA A40 48GB | $140.37 | $140.37 | $15.63 | $109.38 | $7.54 | $17.54 | $5,250 | 27 |
NVIDIA A10 24GB | $48.08 | $12.00 | $5.21 | $62.50 | $2.50 | $6.00 | $1,500 | 62 |
NVIDIA L40 48GB | $60.77 | $30.38 | $9.68 | $114.58 | $6.37 | $15.19 | $5,500 | 28 |
AMD Radeon RX 7900 XT 20GB | $11.35 | $5.73 | $3.51 | $29.50 | $0.74 | $5.73 | $590 | 100 |
NVIDIA L4 24GB | $15.83 | $7.85 | $7.91 | $79.13 | $6.33 | $3.92 | $1,899 | 54 |
NVIDIA RTX A5000 24GB | $50.41 | $50.41 | $5.47 | $58.33 | $1.82 | $3.15 | $1,400 | 83 |
NVIDIA A100 PCIe 80GB | $73.72 | $36.86 | $26.62 | $143.75 | $5.94 | $18.43 | $11,500 | 11 |
NVIDIA Tesla P100 16GB | $13.02 | $6.51 | $โ | $8.62 | $0.19 | $โ | $138 | 100 |
NVIDIA Geforce RTX 4090 24GB | $26.63 | $3.33 | $4.30 | $91.67 | $2.18 | $1.67 | $2,200 | 93 |
NVIDIA Tesla V100 32GB | $99.14 | $49.57 | $2.17 | $43.38 | $1.54 | $24.79 | $1,388 | 41 |
NVIDIA H100 PCIe 80GB | $36.97 | $18.47 | $61.29 | $349.34 | $13.71 | $9.24 | $27,947 | 9 |
AMD Radeon RX 7900 XTX 24GB | $12.30 | $6.10 | $3.91 | $31.25 | $0.78 | $6.10 | $750 | 100 |
NVIDIA L40S 48GB | $44.72 | $22.60 | $14.41 | $170.48 | $9.47 | $5.58 | $8,183 | 26 |
NVIDIA Tesla V100 16GB | $32.14 | $16.07 | $0.70 | $28.12 | $0.50 | $8.04 | $450 | 60 |
AMD Radeon RX 7700 XT 12GB | $10.86 | $5.43 | $3.52 | $31.67 | $0.88 | $โ | $380 | 59 |
AMD Radeon RX 7800 XT 16GB | $12.84 | $6.42 | $3.96 | $29.69 | $0.76 | $โ | $475 | 78 |
AMD Radeon RX 7600 XT 16GB | $15.57 | $7.79 | $5.49 | $21.97 | $1.22 | $โ | $351 | 15 |
NVIDIA GeForce RTX 5080 16GB | $10.48 | $2.62 | $3.51 | $73.75 | $1.23 | $1.31 | $1,180 | 97 |
NVIDIA GeForce RTX 5090 32GB | $12.41 | $3.10 | $3.82 | $81.22 | $1.45 | $1.55 | $2,599 | 99 |
NVIDIA GeForce RTX 5070 Ti 16GB | $7.41 | $1.85 | $2.48 | $52.16 | $0.87 | $0.93 | $835 | 99 |
NVIDIA Geforce RTX 4070 12GB | $8.33 | $2.08 | $2.64 | $40.41 | $0.96 | $1.04 | $485 | 96 |
NVIDIA Geforce RTX 4070 Ti 12GB | $8.47 | $2.12 | $2.83 | $56.58 | $1.35 | $1.06 | $679 | 21 |
NVIDIA Geforce RTX 4080 16GB | $9.24 | $2.26 | $2.96 | $56.25 | $1.26 | $1.15 | $900 | 94 |