GPUs Ranked by Cost per Memory Bandwidth (GB/s)
Something missing? Let us know and we'll add it if we can.
GPU | $ / FP32 TFLOPs | $ / FP16 TFLOPs | $ / Tensor Core Count | $ / Memory Capacity (GB) | $ / Memory Bandwidth (GB/s) | $ / Int8 TOPs | Minimum Price | Available for Sale |
---|---|---|---|---|---|---|---|---|
NVIDIA T4 16GB | $72.22 | $9.00 | $1.83 | $36.56 | $1.83 | $4.50 | $585 | 85 |
NVIDIA A30 24GB | $15.15 | $15.15 | $11.16 | $104.13 | $2.68 | $7.57 | $2,499 | 40 |
NVIDIA A40 48GB | $133.66 | $133.66 | $14.88 | $104.15 | $7.18 | $16.70 | $4,999 | 28 |
NVIDIA A10 24GB | $43.27 | $10.80 | $4.69 | $56.25 | $2.25 | $5.40 | $1,350 | 65 |
NVIDIA L40 48GB | $60.22 | $30.10 | $9.60 | $113.54 | $6.31 | $15.06 | $5,450 | 27 |
AMD Radeon RX 7900 XT 20GB | $11.06 | $5.58 | $3.42 | $28.75 | $0.72 | $5.58 | $575 | 96 |
NVIDIA L4 24GB | $15.83 | $7.85 | $7.91 | $79.13 | $6.33 | $3.92 | $1,899 | 54 |
NVIDIA RTX A5000 24GB | $48.61 | $48.61 | $5.27 | $56.25 | $1.76 | $3.04 | $1,350 | 85 |
NVIDIA A100 PCIe 80GB | $73.72 | $36.86 | $26.62 | $143.75 | $5.94 | $18.43 | $11,500 | 10 |
NVIDIA Tesla P100 16GB | $12.07 | $6.04 | $โ | $8.00 | $0.17 | $โ | $128 | 99 |
NVIDIA Geforce RTX 4090 24GB | $27.84 | $3.48 | $4.49 | $95.83 | $2.28 | $1.74 | $2,300 | 90 |
NVIDIA Tesla V100 32GB | $77.81 | $38.90 | $1.70 | $34.04 | $1.21 | $19.45 | $1,089 | 44 |
NVIDIA H100 PCIe 80GB | $36.92 | $18.45 | $61.21 | $348.91 | $13.69 | $9.22 | $27,913 | 10 |
AMD Radeon RX 7900 XTX 24GB | $11.48 | $5.69 | $3.65 | $29.17 | $0.73 | $5.69 | $700 | 100 |
NVIDIA L40S 48GB | $43.58 | $22.03 | $14.04 | $166.15 | $9.23 | $5.44 | $7,975 | 29 |
NVIDIA Tesla V100 16GB | $29.29 | $14.64 | $0.64 | $25.63 | $0.46 | $7.32 | $410 | 62 |
AMD Radeon RX 7700 XT 12GB | $10.43 | $5.21 | $3.38 | $30.42 | $0.84 | $โ | $365 | 62 |
AMD Radeon RX 7800 XT 16GB | $10.81 | $5.41 | $3.33 | $25.00 | $0.64 | $โ | $400 | 89 |
AMD Radeon RX 7600 XT 16GB | $13.96 | $6.98 | $4.92 | $19.69 | $1.09 | $โ | $315 | 14 |
NVIDIA GeForce RTX 5080 16GB | $10.21 | $2.55 | $3.42 | $71.88 | $1.20 | $1.28 | $1,150 | 99 |
NVIDIA GeForce RTX 5090 32GB | $11.04 | $2.76 | $3.40 | $72.29 | $1.29 | $1.38 | $2,313 | 100 |
NVIDIA GeForce RTX 5070 Ti 16GB | $6.57 | $1.64 | $2.20 | $46.25 | $0.77 | $0.82 | $740 | 98 |
NVIDIA Geforce RTX 4070 12GB | $8.16 | $2.04 | $2.58 | $39.58 | $0.94 | $1.02 | $475 | 94 |
NVIDIA Geforce RTX 4070 Ti 12GB | $8.18 | $2.04 | $2.73 | $54.64 | $1.30 | $1.02 | $656 | 32 |
NVIDIA Geforce RTX 4080 16GB | $9.23 | $2.25 | $2.96 | $56.19 | $1.25 | $1.15 | $899 | 97 |