GPUs Ranked by Cost per FP16 TFLOPs
Something missing? Let us know and we'll add it if we can.
GPU | $ / FP32 TFLOPs | $ / FP16 TFLOPs | $ / Tensor Core Count | $ / Memory Capacity (GB) | $ / Memory Bandwidth (GB/s) | $ / Int8 TOPs | Minimum Price | Available for Sale |
---|---|---|---|---|---|---|---|---|
NVIDIA T4 16GB | $74.07 | $9.23 | $1.88 | $37.50 | $1.88 | $4.62 | $600 | 78 |
NVIDIA A30 24GB | $20.91 | $20.91 | $15.40 | $143.75 | $3.70 | $10.45 | $3,450 | 35 |
NVIDIA A40 48GB | $140.37 | $140.37 | $15.63 | $109.38 | $7.54 | $17.54 | $5,250 | 27 |
NVIDIA A10 24GB | $57.69 | $14.40 | $6.25 | $75.00 | $3.00 | $7.20 | $1,800 | 61 |
NVIDIA L40 48GB | $60.77 | $30.38 | $9.68 | $114.58 | $6.37 | $15.19 | $5,500 | 28 |
AMD Radeon RX 7900 XT 20GB | $11.52 | $5.82 | $3.57 | $29.95 | $0.75 | $5.82 | $599 | 100 |
NVIDIA L4 24GB | $15.83 | $7.85 | $7.91 | $79.13 | $6.33 | $3.92 | $1,899 | 54 |
NVIDIA RTX A5000 24GB | $49.69 | $49.69 | $5.39 | $57.50 | $1.80 | $3.11 | $1,380 | 84 |
NVIDIA A100 PCIe 80GB | $73.72 | $36.86 | $26.62 | $143.75 | $5.94 | $18.43 | $11,500 | 12 |
NVIDIA Tesla P100 16GB | $13.02 | $6.51 | $โ | $8.62 | $0.19 | $โ | $138 | 100 |
NVIDIA Geforce RTX 4090 24GB | $27.24 | $3.41 | $4.39 | $93.75 | $2.23 | $1.70 | $2,250 | 99 |
NVIDIA Tesla V100 32GB | $99.14 | $49.57 | $2.17 | $43.38 | $1.54 | $24.79 | $1,388 | 42 |
NVIDIA H100 PCIe 80GB | $34.39 | $17.18 | $57.02 | $325.00 | $12.75 | $8.59 | $26,000 | 10 |
AMD Radeon RX 7900 XTX 24GB | $12.95 | $6.42 | $4.11 | $32.92 | $0.82 | $6.42 | $790 | 100 |
NVIDIA L40S 48GB | $44.72 | $22.60 | $14.41 | $170.48 | $9.47 | $5.58 | $8,183 | 26 |
NVIDIA Tesla V100 16GB | $32.14 | $16.07 | $0.70 | $28.12 | $0.50 | $8.04 | $450 | 61 |
AMD Radeon RX 7700 XT 12GB | $11.09 | $5.54 | $3.59 | $32.33 | $0.90 | $โ | $388 | 58 |
AMD Radeon RX 7800 XT 16GB | $12.84 | $6.42 | $3.96 | $29.69 | $0.76 | $โ | $475 | 79 |
AMD Radeon RX 7600 XT 16GB | $16.35 | $8.17 | $5.77 | $23.06 | $1.28 | $โ | $369 | 16 |
NVIDIA GeForce RTX 5080 16GB | $10.57 | $2.64 | $3.54 | $74.37 | $1.24 | $1.32 | $1,190 | 100 |
NVIDIA GeForce RTX 5090 32GB | $12.41 | $3.10 | $3.82 | $81.22 | $1.45 | $1.55 | $2,599 | 100 |
NVIDIA GeForce RTX 5070 Ti 16GB | $7.36 | $1.84 | $2.47 | $51.81 | $0.86 | $0.92 | $829 | 100 |
NVIDIA Geforce RTX 4070 12GB | $8.16 | $2.04 | $2.58 | $39.58 | $0.94 | $1.02 | $475 | 65 |
NVIDIA Geforce RTX 4070 Ti 12GB | $7.36 | $1.84 | $2.46 | $49.17 | $1.17 | $0.92 | $590 | 59 |
NVIDIA Geforce RTX 4080 16GB | $9.02 | $2.20 | $2.89 | $54.94 | $1.23 | $1.13 | $879 | 98 |