GPUs Ranked by Cost per Memory Bandwidth (GB/s)
Something missing? Let us know and we'll add it if we can.
GPU | $ / FP32 TFLOPs | $ / FP16 TFLOPs | $ / Tensor Core Count | $ / Memory Capacity (GB) | $ / Memory Bandwidth (GB/s) | $ / Int8 TOPs | Minimum Price | Available for Sale |
---|---|---|---|---|---|---|---|---|
NVIDIA T4 16GB | $61.73 | $7.69 | $1.56 | $31.25 | $1.56 | $3.85 | $500 | 95 |
NVIDIA A30 24GB | $16.67 | $16.67 | $12.28 | $114.58 | $2.95 | $8.33 | $2,750 | 37 |
NVIDIA A40 48GB | $155.89 | $155.89 | $17.35 | $121.47 | $8.38 | $19.48 | $5,830 | 20 |
NVIDIA A10 24GB | $54.78 | $13.67 | $5.93 | $71.21 | $2.85 | $6.84 | $1,709 | 66 |
NVIDIA L40 48GB | $55.19 | $27.59 | $8.79 | $104.06 | $5.78 | $13.80 | $4,995 | 61 |
AMD Radeon RX 7900 XT 20GB | $14.04 | $7.09 | $4.35 | $36.50 | $0.91 | $7.09 | $730 | 65 |
NVIDIA L4 24GB | $16.25 | $8.06 | $8.13 | $81.25 | $6.50 | $4.02 | $1,950 | 37 |
NVIDIA RTX A5000 24GB | $54.73 | $54.73 | $5.94 | $63.33 | $1.98 | $3.42 | $1,520 | 64 |
NVIDIA A100 PCIe 80GB | $115.38 | $57.69 | $41.66 | $224.99 | $9.30 | $28.84 | $17,999 | 11 |
NVIDIA Tesla P100 16GB | $18.86 | $9.43 | $โ | $12.50 | $0.27 | $โ | $200 | 100 |
NVIDIA Geforce RTX 4090 24GB | $27.93 | $3.49 | $4.51 | $96.13 | $2.29 | $1.75 | $2,307 | 98 |
NVIDIA Tesla V100 32GB | $142.79 | $71.39 | $3.12 | $62.47 | $2.22 | $35.70 | $1,999 | 33 |
NVIDIA H100 PCIe 80GB | $35.55 | $17.76 | $58.93 | $335.91 | $13.18 | $8.88 | $26,873 | 13 |
AMD Radeon RX 7900 XTX 24GB | $15.57 | $7.72 | $4.95 | $39.58 | $0.99 | $7.72 | $950 | 86 |
NVIDIA L40S 48GB | $61.20 | $30.94 | $19.72 | $233.31 | $12.96 | $7.64 | $11,199 | 1 |
NVIDIA Tesla V100 16GB | $39.29 | $19.64 | $0.86 | $34.38 | $0.61 | $9.82 | $550 | 51 |
AMD Radeon RX 7700 XT 12GB | $12.00 | $6.00 | $3.89 | $35.00 | $0.97 | $โ | $420 | 43 |
AMD Radeon RX 7800 XT 16GB | $16.08 | $8.04 | $4.96 | $37.19 | $0.95 | $โ | $595 | 64 |
AMD Radeon RX 7600 XT 16GB | $20.10 | $10.05 | $7.09 | $28.35 | $1.58 | $โ | $454 | 11 |
NVIDIA GeForce RTX 5080 16GB | $12.43 | $3.11 | $4.17 | $87.50 | $1.46 | $1.55 | $1,400 | 97 |
NVIDIA GeForce RTX 5090 32GB | $16.61 | $4.15 | $5.12 | $108.75 | $1.94 | $2.08 | $3,480 | 49 |
NVIDIA GeForce RTX 5070 Ti 16GB | $8.87 | $2.22 | $2.97 | $62.44 | $1.04 | $1.11 | $999 | 78 |
NVIDIA Geforce RTX 4070 12GB | $8.57 | $2.14 | $2.71 | $41.54 | $0.99 | $1.07 | $499 | 51 |
NVIDIA Geforce RTX 4070 Ti 12GB | $8.98 | $2.24 | $3.00 | $60.00 | $1.43 | $1.12 | $720 | 40 |
NVIDIA Geforce RTX 4080 16GB | $11.09 | $2.71 | $3.55 | $67.50 | $1.51 | $1.38 | $1,080 | 76 |