GPUs Ranked by Cost per Tensor Core Count
Something missing? Let us know and we'll add it if we can.
GPU | $ / FP32 TFLOPs | $ / FP16 TFLOPs | $ / Tensor Core Count | $ / Memory Capacity (GB) | $ / Memory Bandwidth (GB/s) | $ / Int8 TOPs | Minimum Price | Available for Sale |
---|---|---|---|---|---|---|---|---|
NVIDIA T4 16GB | $67.90 | $8.46 | $1.72 | $34.37 | $1.72 | $4.23 | $550 | 91 |
NVIDIA A30 24GB | $16.36 | $16.36 | $12.05 | $112.46 | $2.89 | $8.18 | $2,699 | 34 |
NVIDIA A40 48GB | $181.82 | $181.82 | $20.24 | $141.67 | $9.77 | $22.72 | $6,800 | 27 |
NVIDIA A10 24GB | $41.63 | $10.39 | $4.51 | $54.13 | $2.17 | $5.20 | $1,299 | 63 |
NVIDIA L40 48GB | $52.49 | $26.24 | $8.36 | $98.96 | $5.50 | $13.12 | $4,750 | 26 |
AMD Radeon RX 7900 XT 20GB | $12.02 | $6.07 | $3.72 | $31.25 | $0.78 | $6.07 | $625 | 71 |
NVIDIA L4 24GB | $17.32 | $8.59 | $8.66 | $86.58 | $6.93 | $4.28 | $2,078 | 33 |
NVIDIA RTX A5000 24GB | $46.78 | $46.78 | $5.07 | $54.13 | $1.69 | $2.92 | $1,299 | 75 |
NVIDIA A100 PCIe 80GB | $102.56 | $51.28 | $37.03 | $199.99 | $8.27 | $25.64 | $15,999 | 12 |
NVIDIA Tesla P100 16GB | $16.51 | $8.25 | $โ | $10.94 | $0.24 | $โ | $175 | 100 |
NVIDIA Geforce RTX 4090 24GB | $26.03 | $3.25 | $4.20 | $89.58 | $2.13 | $1.63 | $2,150 | 99 |
NVIDIA Tesla V100 32GB | $121.43 | $60.71 | $2.66 | $53.12 | $1.89 | $30.36 | $1,700 | 27 |
NVIDIA H100 PCIe 80GB | $38.96 | $19.46 | $64.58 | $368.13 | $14.44 | $9.73 | $29,450 | 8 |
AMD Radeon RX 7900 XTX 24GB | $12.46 | $6.18 | $3.96 | $31.67 | $0.79 | $6.18 | $760 | 100 |
NVIDIA L40S 48GB | $44.72 | $22.60 | $14.41 | $170.48 | $9.47 | $5.58 | $8,183 | 25 |
NVIDIA Tesla V100 16GB | $35.71 | $17.86 | $0.78 | $31.25 | $0.56 | $8.93 | $500 | 54 |
AMD Radeon RX 7700 XT 12GB | $12.00 | $6.00 | $3.89 | $35.00 | $0.97 | $โ | $420 | 43 |
AMD Radeon RX 7800 XT 16GB | $13.80 | $6.90 | $4.25 | $31.90 | $0.82 | $โ | $510 | 60 |
AMD Radeon RX 7600 XT 16GB | $19.05 | $9.53 | $6.72 | $26.87 | $1.49 | $โ | $430 | 8 |
NVIDIA GeForce RTX 5080 16GB | $10.66 | $2.67 | $3.57 | $75.00 | $1.25 | $1.33 | $1,200 | 100 |
NVIDIA GeForce RTX 5090 32GB | $13.98 | $3.50 | $4.31 | $91.53 | $1.63 | $1.75 | $2,929 | 100 |
NVIDIA GeForce RTX 5070 Ti 16GB | $7.55 | $1.89 | $2.53 | $53.13 | $0.89 | $0.94 | $850 | 99 |
NVIDIA Geforce RTX 4070 12GB | $8.59 | $2.14 | $2.72 | $41.67 | $0.99 | $1.07 | $500 | 100 |
NVIDIA Geforce RTX 4070 Ti 12GB | $14.01 | $3.50 | $4.68 | $93.67 | $2.23 | $1.75 | $1,124 | 12 |
NVIDIA Geforce RTX 4080 16GB | $9.25 | $2.26 | $2.96 | $56.32 | $1.26 | $1.16 | $901 | 88 |