GPUs Ranked by Cost per FP32 TFLOPs
Something missing? Let us know and we'll add it if we can.
GPU | $ / FP32 TFLOPs | $ / FP16 TFLOPs | $ / Tensor Core Count | $ / Memory Capacity (GB) | $ / Memory Bandwidth (GB/s) | $ / Int8 TOPs | Minimum Price | Available for Sale |
---|---|---|---|---|---|---|---|---|
NVIDIA T4 16GB | $82.59 | $10.29 | $2.09 | $41.81 | $2.09 | $5.15 | $669 | 83 |
NVIDIA A30 24GB | $14.55 | $14.55 | $10.71 | $100.00 | $2.57 | $7.27 | $2,400 | 32 |
NVIDIA A40 48GB | $160.43 | $160.43 | $17.86 | $125.00 | $8.62 | $20.05 | $6,000 | 27 |
NVIDIA A10 24GB | $40.06 | $10.00 | $4.34 | $52.08 | $2.08 | $5.00 | $1,250 | 68 |
NVIDIA L40 48GB | $62.43 | $31.21 | $9.95 | $117.71 | $6.54 | $15.61 | $5,650 | 54 |
AMD Radeon RX 7900 XT 20GB | $12.02 | $6.07 | $3.72 | $31.25 | $0.78 | $6.07 | $625 | 83 |
NVIDIA L4 24GB | $13.33 | $6.61 | $6.67 | $66.67 | $5.33 | $3.30 | $1,600 | 49 |
NVIDIA RTX A5000 24GB | $52.21 | $52.21 | $5.66 | $60.42 | $1.89 | $3.26 | $1,450 | 81 |
NVIDIA A100 PCIe 80GB | $76.92 | $38.46 | $27.78 | $149.99 | $6.20 | $19.23 | $11,999 | 11 |
NVIDIA Tesla P100 16GB | $14.15 | $7.07 | $โ | $9.37 | $0.20 | $โ | $150 | 100 |
NVIDIA Geforce RTX 4090 24GB | $26.63 | $3.33 | $4.30 | $91.67 | $2.18 | $1.67 | $2,200 | 99 |
NVIDIA Tesla V100 32GB | $92.86 | $46.43 | $2.03 | $40.63 | $1.44 | $23.21 | $1,300 | 34 |
NVIDIA H100 PCIe 80GB | $31.74 | $15.86 | $52.63 | $299.99 | $11.77 | $7.93 | $23,999 | 8 |
AMD Radeon RX 7900 XTX 24GB | $13.11 | $6.50 | $4.17 | $33.33 | $0.83 | $6.50 | $800 | 100 |
NVIDIA L40S 48GB | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 |
NVIDIA Tesla V100 16GB | $32.86 | $16.43 | $0.72 | $28.75 | $0.51 | $8.21 | $460 | 55 |
AMD Radeon RX 7700 XT 12GB | $11.46 | $5.73 | $3.71 | $33.42 | $0.93 | $โ | $401 | 53 |
AMD Radeon RX 7800 XT 16GB | $12.84 | $6.42 | $3.96 | $29.69 | $0.76 | $โ | $475 | 64 |
AMD Radeon RX 7600 XT 16GB | $15.51 | $7.75 | $5.47 | $21.87 | $1.22 | $โ | $350 | 8 |
NVIDIA GeForce RTX 5080 16GB | $11.10 | $2.78 | $3.72 | $78.12 | $1.30 | $1.39 | $1,250 | 97 |
NVIDIA GeForce RTX 5090 32GB | $12.64 | $3.16 | $3.89 | $82.72 | $1.48 | $1.58 | $2,647 | 98 |
NVIDIA GeForce RTX 5070 Ti 16GB | $7.54 | $1.89 | $2.53 | $53.06 | $0.88 | $0.94 | $849 | 99 |
NVIDIA Geforce RTX 4070 12GB | $8.59 | $2.14 | $2.72 | $41.67 | $0.99 | $1.07 | $500 | 95 |
NVIDIA Geforce RTX 4070 Ti 12GB | $8.65 | $2.16 | $2.89 | $57.79 | $1.38 | $1.08 | $693 | 27 |
NVIDIA Geforce RTX 4080 16GB | $8.79 | $2.15 | $2.82 | $53.52 | $1.19 | $1.10 | $856 | 98 |