GPUs Ranked by Cost per FP32 TFLOPs
Something missing? Let us know and we'll add it if we can.
GPU | $ / FP32 TFLOPs | $ / FP16 TFLOPs | $ / Tensor Core Count | $ / Memory Capacity (GB) | $ / Memory Bandwidth (GB/s) | $ / Int8 TOPs | Minimum Price | Available for Sale |
---|---|---|---|---|---|---|---|---|
NVIDIA T4 16GB | $79.01 | $9.85 | $2.00 | $40.00 | $2.00 | $4.92 | $640 | 83 |
NVIDIA A30 24GB | $13.33 | $13.33 | $9.82 | $91.63 | $2.36 | $6.66 | $2,199 | 44 |
NVIDIA A40 48GB | $140.37 | $140.37 | $15.63 | $109.38 | $7.54 | $17.54 | $5,250 | 27 |
NVIDIA A10 24GB | $43.27 | $10.80 | $4.69 | $56.25 | $2.25 | $5.40 | $1,350 | 64 |
NVIDIA L40 48GB | $60.22 | $30.10 | $9.60 | $113.54 | $6.31 | $15.06 | $5,450 | 27 |
AMD Radeon RX 7900 XT 20GB | $10.96 | $5.53 | $3.39 | $28.50 | $0.71 | $5.53 | $570 | 87 |
NVIDIA L4 24GB | $15.63 | $7.75 | $7.81 | $78.13 | $6.25 | $3.87 | $1,875 | 55 |
NVIDIA RTX A5000 24GB | $43.18 | $43.18 | $4.68 | $49.96 | $1.56 | $2.70 | $1,199 | 86 |
NVIDIA A100 PCIe 80GB | $73.08 | $36.54 | $26.39 | $142.50 | $5.89 | $18.27 | $11,400 | 12 |
NVIDIA Tesla P100 16GB | $11.60 | $5.80 | $โ | $7.68 | $0.17 | $โ | $123 | 98 |
NVIDIA Geforce RTX 4090 24GB | $26.42 | $3.30 | $4.26 | $90.94 | $2.17 | $1.65 | $2,183 | 100 |
NVIDIA Tesla V100 32GB | $77.95 | $38.97 | $1.71 | $34.10 | $1.21 | $19.49 | $1,091 | 44 |
NVIDIA H100 PCIe 80GB | $26.45 | $13.22 | $43.86 | $249.99 | $9.81 | $6.61 | $19,999 | 10 |
AMD Radeon RX 7900 XTX 24GB | $12.13 | $6.02 | $3.85 | $30.83 | $0.77 | $6.02 | $740 | 100 |
NVIDIA L40S 48GB | $42.35 | $21.41 | $13.64 | $161.46 | $8.97 | $5.29 | $7,750 | 28 |
NVIDIA Tesla V100 16GB | $29.29 | $14.64 | $0.64 | $25.63 | $0.46 | $7.32 | $410 | 61 |
AMD Radeon RX 7700 XT 12GB | $10.00 | $5.00 | $3.24 | $29.17 | $0.81 | $โ | $350 | 51 |
AMD Radeon RX 7800 XT 16GB | $12.84 | $6.42 | $3.96 | $29.69 | $0.76 | $โ | $475 | 68 |
AMD Radeon RX 7600 XT 16GB | $12.63 | $6.31 | $4.45 | $17.81 | $0.99 | $โ | $285 | 11 |
NVIDIA GeForce RTX 5080 16GB | $10.12 | $2.53 | $3.39 | $71.25 | $1.19 | $1.27 | $1,140 | 100 |
NVIDIA GeForce RTX 5090 32GB | $10.57 | $2.64 | $3.26 | $69.23 | $1.24 | $1.32 | $2,215 | 100 |
NVIDIA GeForce RTX 5070 Ti 16GB | $7.46 | $1.86 | $2.50 | $52.47 | $0.87 | $0.93 | $840 | 100 |
NVIDIA Geforce RTX 4070 12GB | $8.25 | $2.06 | $2.61 | $40.00 | $0.95 | $1.03 | $480 | 62 |
NVIDIA Geforce RTX 4070 Ti 12GB | $7.29 | $1.82 | $2.44 | $48.75 | $1.16 | $0.91 | $585 | 59 |
NVIDIA Geforce RTX 4080 16GB | $8.62 | $2.11 | $2.76 | $52.50 | $1.17 | $1.08 | $840 | 97 |