GPUs Ranked by Cost per Memory Bandwidth (GB/s)
Something missing? Let us know and we'll add it if we can.
GPU | $ / FP32 TFLOPs | $ / FP16 TFLOPs | $ / Tensor Core Count | $ / Memory Capacity (GB) | $ / Memory Bandwidth (GB/s) | $ / Int8 TOPs | Minimum Price | Available for Sale |
---|---|---|---|---|---|---|---|---|
NVIDIA T4 16GB | $72.84 | $9.08 | $1.84 | $36.88 | $1.84 | $4.54 | $590 | 88 |
NVIDIA A30 24GB | $19.03 | $19.03 | $14.02 | $130.83 | $3.36 | $9.52 | $3,140 | 34 |
NVIDIA A40 48GB | $177.79 | $177.79 | $19.79 | $138.53 | $9.55 | $22.22 | $6,649 | 23 |
NVIDIA A10 24GB | $54.78 | $13.67 | $5.93 | $71.21 | $2.85 | $6.84 | $1,709 | 59 |
NVIDIA L40 48GB | $63.54 | $31.76 | $10.12 | $119.79 | $6.66 | $15.88 | $5,750 | 29 |
AMD Radeon RX 7900 XT 20GB | $13.44 | $6.79 | $4.16 | $34.95 | $0.87 | $6.79 | $699 | 76 |
NVIDIA L4 24GB | $16.66 | $8.26 | $8.33 | $83.32 | $6.67 | $4.12 | $2,000 | 35 |
NVIDIA RTX A5000 24GB | $46.81 | $46.81 | $5.08 | $54.16 | $1.69 | $2.93 | $1,300 | 65 |
NVIDIA A100 PCIe 80GB | $104.17 | $52.08 | $37.62 | $203.13 | $8.40 | $26.04 | $16,250 | 12 |
NVIDIA Tesla P100 16GB | $17.45 | $8.73 | $โ | $11.56 | $0.25 | $โ | $185 | 99 |
NVIDIA Geforce RTX 4090 24GB | $29.00 | $3.63 | $4.68 | $99.79 | $2.38 | $1.81 | $2,395 | 94 |
NVIDIA Tesla V100 32GB | $128.57 | $64.29 | $2.81 | $56.25 | $2.00 | $32.14 | $1,800 | 35 |
NVIDIA H100 PCIe 80GB | $36.70 | $18.34 | $60.85 | $346.82 | $13.61 | $9.17 | $27,745 | 15 |
AMD Radeon RX 7900 XTX 24GB | $14.75 | $7.32 | $4.69 | $37.50 | $0.94 | $7.32 | $900 | 86 |
NVIDIA L40S 48GB | $44.72 | $22.60 | $14.41 | $170.48 | $9.47 | $5.58 | $8,183 | 25 |
NVIDIA Tesla V100 16GB | $42.86 | $21.43 | $0.94 | $37.50 | $0.67 | $10.71 | $600 | 43 |
AMD Radeon RX 7700 XT 12GB | $12.86 | $6.43 | $4.17 | $37.50 | $1.04 | $โ | $450 | 43 |
AMD Radeon RX 7800 XT 16GB | $16.22 | $8.11 | $5.00 | $37.50 | $0.96 | $โ | $600 | 57 |
AMD Radeon RX 7600 XT 16GB | $17.72 | $8.86 | $6.25 | $25.00 | $1.39 | $โ | $400 | 9 |
NVIDIA GeForce RTX 5080 16GB | $12.88 | $3.22 | $4.32 | $90.62 | $1.51 | $1.61 | $1,450 | 100 |
NVIDIA GeForce RTX 5090 32GB | $16.22 | $4.05 | $5.00 | $106.19 | $1.90 | $2.03 | $3,398 | 74 |
NVIDIA GeForce RTX 5070 Ti 16GB | $8.97 | $2.24 | $3.01 | $63.12 | $1.05 | $1.12 | $1,010 | 82 |
NVIDIA Geforce RTX 4070 12GB | $9.88 | $2.47 | $3.13 | $47.92 | $1.14 | $1.23 | $575 | 64 |
NVIDIA Geforce RTX 4070 Ti 12GB | $8.73 | $2.18 | $2.92 | $58.33 | $1.39 | $1.09 | $700 | 37 |
NVIDIA Geforce RTX 4080 16GB | $10.77 | $2.63 | $3.45 | $65.56 | $1.46 | $1.35 | $1,049 | 68 |