GPUs Ranked by Cost per Tensor Core Count
Something missing? Let us know and we'll add it if we can.
GPU | $ / FP32 TFLOPs | $ / FP16 TFLOPs | $ / Tensor Core Count | $ / Memory Capacity (GB) | $ / Memory Bandwidth (GB/s) | $ / Int8 TOPs | Minimum Price | Available for Sale |
---|---|---|---|---|---|---|---|---|
NVIDIA T4 16GB | $3.24 | $0.40 | $0.08 | $1.64 | $0.08 | $0.20 | $26 | 85 |
NVIDIA A30 24GB | $21.27 | $21.27 | $15.67 | $146.25 | $3.76 | $10.64 | $3,510 | 37 |
NVIDIA A40 48GB | $155.69 | $155.69 | $17.33 | $121.31 | $8.37 | $19.46 | $5,823 | 26 |
NVIDIA A10 24GB | $57.53 | $14.36 | $6.23 | $74.79 | $2.99 | $7.18 | $1,795 | 66 |
NVIDIA L40 48GB | $55.19 | $27.59 | $8.79 | $104.06 | $5.78 | $13.80 | $4,995 | 41 |
AMD Radeon RX 7900 XT 20GB | $13.17 | $6.65 | $4.08 | $34.25 | $0.86 | $6.65 | $685 | 59 |
NVIDIA L4 24GB | $16.67 | $8.26 | $8.33 | $83.33 | $6.67 | $4.12 | $2,000 | 36 |
NVIDIA RTX A5000 24GB | $47.89 | $47.89 | $5.20 | $55.42 | $1.73 | $2.99 | $1,330 | 66 |
NVIDIA A100 PCIe 80GB | $115.38 | $57.69 | $41.66 | $224.99 | $9.30 | $28.84 | $17,999 | 19 |
NVIDIA Tesla P100 16GB | $2.98 | $1.49 | $โ | $1.98 | $0.04 | $โ | $32 | 100 |
NVIDIA Geforce RTX 4090 24GB | $27.23 | $3.40 | $4.39 | $93.71 | $2.23 | $1.70 | $2,249 | 99 |
NVIDIA Tesla V100 32GB | $124.30 | $62.15 | $2.72 | $54.38 | $1.93 | $31.08 | $1,740 | 34 |
NVIDIA H100 PCIe 80GB | $35.39 | $17.68 | $58.67 | $334.43 | $13.12 | $8.84 | $26,755 | 11 |
AMD Radeon RX 7900 XTX 24GB | $16.39 | $8.13 | $5.21 | $41.67 | $1.04 | $8.13 | $1,000 | 74 |
NVIDIA L40S 48GB | $43.69 | $22.09 | $14.08 | $166.56 | $9.25 | $5.45 | $7,995 | 27 |
NVIDIA Tesla V100 16GB | $46.43 | $23.21 | $1.02 | $40.63 | $0.72 | $11.61 | $650 | 45 |
AMD Radeon RX 7700 XT 12GB | $12.86 | $6.43 | $4.17 | $37.50 | $1.04 | $โ | $450 | 37 |
AMD Radeon RX 7800 XT 16GB | $15.67 | $7.84 | $4.83 | $36.25 | $0.93 | $โ | $580 | 55 |
AMD Radeon RX 7600 XT 16GB | $20.10 | $10.05 | $7.09 | $28.35 | $1.58 | $โ | $454 | 10 |
NVIDIA GeForce RTX 5080 16GB | $13.76 | $3.44 | $4.61 | $96.81 | $1.61 | $1.72 | $1,549 | 94 |
NVIDIA GeForce RTX 5090 32GB | $9.30 | $2.33 | $2.87 | $60.89 | $1.09 | $1.16 | $1,949 | 47 |
NVIDIA GeForce RTX 5070 Ti 16GB | $9.64 | $2.41 | $3.23 | $67.81 | $1.13 | $1.21 | $1,085 | 87 |
NVIDIA Geforce RTX 4070 12GB | $8.57 | $2.14 | $2.71 | $41.54 | $0.99 | $1.07 | $499 | 45 |
NVIDIA Geforce RTX 4070 Ti 12GB | $9.98 | $2.49 | $3.33 | $66.67 | $1.59 | $1.25 | $800 | 30 |
NVIDIA Geforce RTX 4080 16GB | $14.25 | $3.48 | $4.57 | $86.75 | $1.94 | $1.78 | $1,388 | 81 |