GPUs Ranked by Cost per Memory Bandwidth (GB/s)
Something missing? Let us know and we'll add it if we can.
GPU | $ / FP32 TFLOPs | $ / FP16 TFLOPs | $ / Tensor Core Count | $ / Memory Capacity (GB) | $ / Memory Bandwidth (GB/s) | $ / Int8 TOPs | Minimum Price | Available for Sale |
---|---|---|---|---|---|---|---|---|
NVIDIA T4 16GB | $74.07 | $9.23 | $1.87 | $37.50 | $1.87 | $4.62 | $600 | 92 |
NVIDIA A30 24GB | $17.33 | $17.33 | $12.77 | $119.17 | $3.06 | $8.67 | $2,860 | 36 |
NVIDIA A40 48GB | $176.79 | $176.79 | $19.68 | $137.75 | $9.50 | $22.09 | $6,612 | 26 |
NVIDIA A10 24GB | $48.08 | $12.00 | $5.21 | $62.50 | $2.50 | $6.00 | $1,500 | 61 |
NVIDIA L40 48GB | $50.94 | $25.46 | $8.12 | $96.04 | $5.34 | $12.73 | $4,610 | 26 |
AMD Radeon RX 7900 XT 20GB | $13.46 | $6.80 | $4.17 | $35.00 | $0.88 | $6.80 | $700 | 72 |
NVIDIA L4 24GB | $17.33 | $8.59 | $8.66 | $86.63 | $6.93 | $4.29 | $2,079 | 29 |
NVIDIA RTX A5000 24GB | $56.50 | $56.50 | $6.13 | $65.38 | $2.04 | $3.53 | $1,569 | 68 |
NVIDIA A100 PCIe 80GB | $104.17 | $52.08 | $37.62 | $203.13 | $8.40 | $26.04 | $16,250 | 11 |
NVIDIA Tesla P100 16GB | $16.51 | $8.25 | $โ | $10.94 | $0.24 | $โ | $175 | 100 |
NVIDIA Geforce RTX 4090 24GB | $27.83 | $3.48 | $4.49 | $95.79 | $2.28 | $1.74 | $2,299 | 100 |
NVIDIA Tesla V100 32GB | $111.05 | $55.53 | $2.43 | $48.59 | $1.73 | $27.76 | $1,555 | 33 |
NVIDIA H100 PCIe 80GB | $38.35 | $19.16 | $63.59 | $362.44 | $14.22 | $9.58 | $28,995 | 12 |
AMD Radeon RX 7900 XTX 24GB | $13.69 | $6.79 | $4.35 | $34.79 | $0.87 | $6.79 | $835 | 100 |
NVIDIA L40S 48GB | $44.72 | $22.60 | $14.41 | $170.48 | $9.47 | $5.58 | $8,183 | 25 |
NVIDIA Tesla V100 16GB | $45.00 | $22.50 | $0.98 | $39.37 | $0.70 | $11.25 | $630 | 45 |
AMD Radeon RX 7700 XT 12GB | $13.28 | $6.64 | $4.31 | $38.75 | $1.08 | $โ | $465 | 44 |
AMD Radeon RX 7800 XT 16GB | $15.13 | $7.57 | $4.67 | $35.00 | $0.90 | $โ | $560 | 61 |
AMD Radeon RX 7600 XT 16GB | $15.51 | $7.75 | $5.47 | $21.87 | $1.22 | $โ | $350 | 9 |
NVIDIA GeForce RTX 5080 16GB | $11.54 | $2.89 | $3.87 | $81.25 | $1.35 | $1.44 | $1,300 | 100 |
NVIDIA GeForce RTX 5090 32GB | $15.03 | $3.76 | $4.63 | $98.38 | $1.76 | $1.88 | $3,148 | 81 |
NVIDIA GeForce RTX 5070 Ti 16GB | $8.79 | $2.20 | $2.95 | $61.87 | $1.03 | $1.10 | $990 | 93 |
NVIDIA Geforce RTX 4070 12GB | $9.04 | $2.26 | $2.86 | $43.83 | $1.04 | $1.13 | $526 | 96 |
NVIDIA Geforce RTX 4070 Ti 12GB | $14.01 | $3.50 | $4.68 | $93.67 | $2.23 | $1.75 | $1,124 | 12 |
NVIDIA Geforce RTX 4080 16GB | $9.88 | $2.41 | $3.16 | $60.13 | $1.34 | $1.23 | $962 | 83 |