GPUs Ranked by Cost per FP32 TFLOPs
Something missing? Let us know and we'll add it if we can.
GPU | $ / FP32 TFLOPs | $ / FP16 TFLOPs | $ / Tensor Core Count | $ / Memory Capacity (GB) | $ / Memory Bandwidth (GB/s) | $ / Int8 TOPs | Minimum Price | Available for Sale |
---|---|---|---|---|---|---|---|---|
NVIDIA T4 16GB | $77.16 | $9.62 | $1.95 | $39.06 | $1.95 | $4.81 | $625 | 82 |
NVIDIA A30 24GB | $13.94 | $13.94 | $10.27 | $95.83 | $2.46 | $6.97 | $2,300 | 33 |
NVIDIA A40 48GB | $126.74 | $126.74 | $14.11 | $98.75 | $6.81 | $15.84 | $4,740 | 32 |
NVIDIA A10 24GB | $44.84 | $11.19 | $4.86 | $58.29 | $2.33 | $5.60 | $1,399 | 63 |
NVIDIA L40 48GB | $62.43 | $31.21 | $9.95 | $117.71 | $6.54 | $15.61 | $5,650 | 27 |
AMD Radeon RX 7900 XT 20GB | $11.83 | $5.97 | $3.66 | $30.75 | $0.77 | $5.97 | $615 | 84 |
NVIDIA L4 24GB | $17.27 | $8.56 | $8.63 | $86.33 | $6.91 | $4.27 | $2,072 | 46 |
NVIDIA RTX A5000 24GB | $53.27 | $53.27 | $5.78 | $61.63 | $1.93 | $3.33 | $1,479 | 81 |
NVIDIA A100 PCIe 80GB | $76.92 | $38.46 | $27.78 | $149.99 | $6.20 | $19.23 | $11,999 | 11 |
NVIDIA Tesla P100 16GB | $13.96 | $6.98 | $โ | $9.25 | $0.20 | $โ | $148 | 99 |
NVIDIA Geforce RTX 4090 24GB | $26.63 | $3.33 | $4.30 | $91.67 | $2.18 | $1.67 | $2,200 | 100 |
NVIDIA Tesla V100 32GB | $107.14 | $53.57 | $2.34 | $46.87 | $1.67 | $26.79 | $1,500 | 34 |
NVIDIA H100 PCIe 80GB | $30.42 | $15.20 | $50.44 | $287.49 | $11.28 | $7.60 | $22,999 | 8 |
AMD Radeon RX 7900 XTX 24GB | $12.46 | $6.18 | $3.96 | $31.67 | $0.79 | $6.18 | $760 | 99 |
NVIDIA L40S 48GB | $44.72 | $22.60 | $14.41 | $170.48 | $9.47 | $5.58 | $8,183 | 24 |
NVIDIA Tesla V100 16GB | $35.71 | $17.85 | $0.78 | $31.24 | $0.56 | $8.93 | $500 | 56 |
AMD Radeon RX 7700 XT 12GB | $10.29 | $5.14 | $3.33 | $30.00 | $0.83 | $โ | $360 | 50 |
AMD Radeon RX 7800 XT 16GB | $13.24 | $6.62 | $4.08 | $30.62 | $0.79 | $โ | $490 | 66 |
AMD Radeon RX 7600 XT 16GB | $13.07 | $6.54 | $4.61 | $18.44 | $1.02 | $โ | $295 | 11 |
NVIDIA GeForce RTX 5080 16GB | $10.71 | $2.68 | $3.59 | $75.40 | $1.26 | $1.34 | $1,206 | 100 |
NVIDIA GeForce RTX 5090 32GB | $12.41 | $3.10 | $3.82 | $81.22 | $1.45 | $1.55 | $2,599 | 98 |
NVIDIA GeForce RTX 5070 Ti 16GB | $7.33 | $1.83 | $2.46 | $51.56 | $0.86 | $0.92 | $825 | 100 |
NVIDIA Geforce RTX 4070 12GB | $8.33 | $2.08 | $2.64 | $40.42 | $0.96 | $1.04 | $485 | 95 |
NVIDIA Geforce RTX 4070 Ti 12GB | $11.22 | $2.81 | $3.75 | $75.00 | $1.79 | $1.40 | $900 | 22 |
NVIDIA Geforce RTX 4080 16GB | $9.45 | $2.31 | $3.03 | $57.50 | $1.28 | $1.18 | $920 | 94 |