GPUs Ranked by Cost per FP16 TFLOPs
Something missing? Let us know and we'll add it if we can.
GPU | $ / FP32 TFLOPs | $ / FP16 TFLOPs | $ / Tensor Core Count | $ / Memory Capacity (GB) | $ / Memory Bandwidth (GB/s) | $ / Int8 TOPs | Minimum Price | Available for Sale |
---|---|---|---|---|---|---|---|---|
NVIDIA T4 16GB | $82.59 | $10.29 | $2.09 | $41.81 | $2.09 | $5.15 | $669 | 83 |
NVIDIA A30 24GB | $14.55 | $14.55 | $10.71 | $100.00 | $2.57 | $7.27 | $2,400 | 31 |
NVIDIA A40 48GB | $160.43 | $160.43 | $17.86 | $125.00 | $8.62 | $20.05 | $6,000 | 27 |
NVIDIA A10 24GB | $40.06 | $10.00 | $4.34 | $52.08 | $2.08 | $5.00 | $1,250 | 68 |
NVIDIA L40 48GB | $62.43 | $31.21 | $9.95 | $117.71 | $6.54 | $15.61 | $5,650 | 29 |
AMD Radeon RX 7900 XT 20GB | $12.12 | $6.12 | $3.75 | $31.50 | $0.79 | $6.12 | $630 | 85 |
NVIDIA L4 24GB | $13.33 | $6.61 | $6.67 | $66.67 | $5.33 | $3.30 | $1,600 | 49 |
NVIDIA RTX A5000 24GB | $53.27 | $53.27 | $5.78 | $61.63 | $1.93 | $3.33 | $1,479 | 81 |
NVIDIA A100 PCIe 80GB | $76.92 | $38.46 | $27.78 | $149.99 | $6.20 | $19.23 | $11,999 | 11 |
NVIDIA Tesla P100 16GB | $14.15 | $7.07 | $โ | $9.37 | $0.20 | $โ | $150 | 100 |
NVIDIA Geforce RTX 4090 24GB | $26.63 | $3.33 | $4.30 | $91.67 | $2.18 | $1.67 | $2,200 | 96 |
NVIDIA Tesla V100 32GB | $92.86 | $46.43 | $2.03 | $40.63 | $1.44 | $23.21 | $1,300 | 33 |
NVIDIA H100 PCIe 80GB | $31.74 | $15.86 | $52.63 | $299.99 | $11.77 | $7.93 | $23,999 | 8 |
AMD Radeon RX 7900 XTX 24GB | $13.11 | $6.50 | $4.17 | $33.33 | $0.83 | $6.50 | $800 | 100 |
NVIDIA L40S 48GB | $44.72 | $22.60 | $14.41 | $170.48 | $9.47 | $5.58 | $8,183 | 25 |
NVIDIA Tesla V100 16GB | $30.36 | $15.18 | $0.66 | $26.56 | $0.47 | $7.59 | $425 | 58 |
AMD Radeon RX 7700 XT 12GB | $11.46 | $5.73 | $3.71 | $33.42 | $0.93 | $โ | $401 | 53 |
AMD Radeon RX 7800 XT 16GB | $13.11 | $6.55 | $4.04 | $30.31 | $0.78 | $โ | $485 | 62 |
AMD Radeon RX 7600 XT 16GB | $15.51 | $7.75 | $5.47 | $21.87 | $1.22 | $โ | $350 | 8 |
NVIDIA GeForce RTX 5080 16GB | $11.10 | $2.78 | $3.72 | $78.12 | $1.30 | $1.39 | $1,250 | 100 |
NVIDIA GeForce RTX 5090 32GB | $12.41 | $3.10 | $3.82 | $81.22 | $1.45 | $1.55 | $2,599 | 98 |
NVIDIA GeForce RTX 5070 Ti 16GB | $7.54 | $1.89 | $2.53 | $53.06 | $0.88 | $0.94 | $849 | 99 |
NVIDIA Geforce RTX 4070 12GB | $8.59 | $2.14 | $2.72 | $41.66 | $0.99 | $1.07 | $500 | 98 |
NVIDIA Geforce RTX 4070 Ti 12GB | $9.03 | $2.26 | $3.02 | $60.38 | $1.44 | $1.13 | $725 | 27 |
NVIDIA Geforce RTX 4080 16GB | $8.79 | $2.15 | $2.82 | $53.52 | $1.19 | $1.10 | $856 | 99 |