GPUs Ranked by Cost per Tensor Core Count
Something missing? Let us know and we'll add it if we can.
GPU | $ / FP32 TFLOPs | $ / FP16 TFLOPs | $ / Tensor Core Count | $ / Memory Capacity (GB) | $ / Memory Bandwidth (GB/s) | $ / Int8 TOPs | Minimum Price | Available for Sale |
---|---|---|---|---|---|---|---|---|
NVIDIA T4 16GB | $64.20 | $8.00 | $1.63 | $32.50 | $1.63 | $4.00 | $520 | 85 |
NVIDIA A30 24GB | $14.55 | $14.55 | $10.71 | $100.00 | $2.57 | $7.27 | $2,400 | 33 |
NVIDIA A40 48GB | $160.43 | $160.43 | $17.86 | $125.00 | $8.62 | $20.05 | $6,000 | 28 |
NVIDIA A10 24GB | $41.63 | $10.39 | $4.51 | $54.13 | $2.17 | $5.20 | $1,299 | 67 |
NVIDIA L40 48GB | $49.72 | $24.85 | $7.92 | $93.75 | $5.21 | $12.43 | $4,500 | 28 |
AMD Radeon RX 7900 XT 20GB | $12.50 | $6.31 | $3.87 | $32.50 | $0.81 | $6.31 | $650 | 75 |
NVIDIA L4 24GB | $17.27 | $8.56 | $8.63 | $86.33 | $6.91 | $4.27 | $2,072 | 46 |
NVIDIA RTX A5000 24GB | $53.63 | $53.63 | $5.82 | $62.05 | $1.94 | $3.35 | $1,489 | 71 |
NVIDIA A100 PCIe 80GB | $76.92 | $38.46 | $27.78 | $149.99 | $6.20 | $19.23 | $11,999 | 11 |
NVIDIA Tesla P100 16GB | $14.15 | $7.07 | $โ | $9.37 | $0.20 | $โ | $150 | 100 |
NVIDIA Geforce RTX 4090 24GB | $26.63 | $3.33 | $4.30 | $91.67 | $2.18 | $1.67 | $2,200 | 100 |
NVIDIA Tesla V100 32GB | $114.29 | $57.14 | $2.50 | $50.00 | $1.78 | $28.57 | $1,600 | 36 |
NVIDIA H100 PCIe 80GB | $33.07 | $16.52 | $54.82 | $312.49 | $12.26 | $8.26 | $24,999 | 8 |
AMD Radeon RX 7900 XTX 24GB | $12.95 | $6.42 | $4.11 | $32.92 | $0.82 | $6.42 | $790 | 100 |
NVIDIA L40S 48GB | $44.72 | $22.60 | $14.41 | $170.48 | $9.47 | $5.58 | $8,183 | 25 |
NVIDIA Tesla V100 16GB | $30.36 | $15.18 | $0.66 | $26.56 | $0.47 | $7.59 | $425 | 58 |
AMD Radeon RX 7700 XT 12GB | $11.43 | $5.71 | $3.70 | $33.33 | $0.93 | $โ | $400 | 49 |
AMD Radeon RX 7800 XT 16GB | $13.27 | $6.63 | $4.09 | $30.69 | $0.79 | $โ | $491 | 64 |
AMD Radeon RX 7600 XT 16GB | $17.72 | $8.86 | $6.25 | $25.00 | $1.39 | $โ | $400 | 9 |
NVIDIA GeForce RTX 5080 16GB | $10.66 | $2.67 | $3.57 | $75.00 | $1.25 | $1.33 | $1,200 | 99 |
NVIDIA GeForce RTX 5090 32GB | $12.46 | $3.11 | $3.84 | $81.57 | $1.46 | $1.56 | $2,610 | 98 |
NVIDIA GeForce RTX 5070 Ti 16GB | $7.54 | $1.89 | $2.53 | $53.06 | $0.88 | $0.94 | $849 | 99 |
NVIDIA Geforce RTX 4070 12GB | $8.57 | $2.14 | $2.71 | $41.58 | $0.99 | $1.07 | $499 | 99 |
NVIDIA Geforce RTX 4070 Ti 12GB | $9.03 | $2.26 | $3.02 | $60.38 | $1.44 | $1.13 | $725 | 26 |
NVIDIA Geforce RTX 4080 16GB | $9.24 | $2.26 | $2.96 | $56.25 | $1.26 | $1.15 | $900 | 91 |