GPUs Ranked by Cost per Tensor Core Count
Something missing? Let us know and we'll add it if we can.
| GPU | $ / Tensor Core Count | $ / FP32 TFLOPs | $ / FP16 TFLOPs | $ / Int8 TOPs | $ / Memory Capacity (GB) | $ / Memory Bandwidth (GB/s) | Minimum Price | Available for Sale |
|---|---|---|---|---|---|---|---|---|
| NVIDIA T4 16GB | $2.03 | $80.25 | $10.00 | $5.00 | $40.63 | $2.03 | $650 | 73 |
| NVIDIA A30 24GB | $12.28 | $16.67 | $16.67 | $8.33 | $114.57 | $2.95 | $2,750 | 38 |
| NVIDIA A40 48GB | $14.58 | $131.02 | $131.02 | $16.37 | $102.08 | $7.04 | $4,900 | 31 |
| NVIDIA A10 24GB | $5.20 | $48.04 | $11.99 | $6.00 | $62.46 | $2.50 | $1,499 | 55 |
| NVIDIA L40 48GB | $11.14 | $69.89 | $34.94 | $17.47 | $131.77 | $7.32 | $6,325 | 32 |
| AMD Radeon RX 7900 XT 20GB | $3.57 | $11.54 | $5.83 | $5.83 | $30.00 | $0.75 | $600 | 58 |
| NVIDIA L4 24GB | $7.50 | $14.99 | $7.43 | $3.71 | $74.96 | $6.00 | $1,799 | 31 |
| NVIDIA RTX A5000 24GB | $5.31 | $48.94 | $48.94 | $3.06 | $56.63 | $1.77 | $1,359 | 60 |
| NVIDIA A100 PCIe 80GB | $43.80 | $121.28 | $60.64 | $30.32 | $236.50 | $9.78 | $18,920 | 11 |
| NVIDIA Tesla P100 16GB | $∞ | $16.51 | $8.25 | $∞ | $10.94 | $0.24 | $175 | 80 |
| NVIDIA RTX 4090 24GB | $3.40 | $21.07 | $5.27 | $2.63 | $72.50 | $1.73 | $1,740 | 95 |
| NVIDIA Tesla V100 32GB | $1.09 | $49.93 | $24.96 | $12.48 | $21.84 | $0.78 | $699 | 44 |
| AMD Radeon RX 7900 XTX 24GB | $4.01 | $12.62 | $6.26 | $6.26 | $32.08 | $0.80 | $770 | 63 |
| NVIDIA H100 PCIe 80GB | $55.48 | $33.47 | $16.72 | $8.36 | $316.25 | $12.41 | $25,300 | 14 |
| NVIDIA L40S 48GB | $13.20 | $40.98 | $20.72 | $5.12 | $156.25 | $8.68 | $7,500 | 19 |
| NVIDIA Tesla V100 16GB | $1.01 | $46.07 | $23.04 | $11.52 | $40.31 | $0.72 | $645 | 45 |
| AMD Radeon RX 7800 XT 16GB | $3.63 | $11.76 | $5.88 | $∞ | $27.19 | $0.70 | $435 | 59 |
| AMD Radeon RX 7700 XT 12GB | $3.84 | $11.86 | $5.93 | $∞ | $34.58 | $0.96 | $415 | 40 |
| AMD Radeon RX 7600 XT 16GB | $5.16 | $14.62 | $7.31 | $∞ | $20.62 | $1.15 | $330 | 25 |