GPUs Ranked by Cost per Memory Capacity (GB)
Something missing? Let us know and we'll add it if we can.
GPU | $ / FP32 TFLOPs | $ / FP16 TFLOPs | $ / Tensor Core Count | $ / Memory Capacity (GB) | $ / Memory Bandwidth (GB/s) | $ / Int8 TOPs | Minimum Price | Available for Sale |
---|---|---|---|---|---|---|---|---|
NVIDIA T4 16GB | $73.95 | $9.22 | $1.87 | $37.44 | $1.87 | $4.61 | $599 | 69 |
NVIDIA A30 24GB | $17.88 | $17.88 | $13.17 | $122.92 | $3.16 | $8.94 | $2,950 | 33 |
NVIDIA A40 48GB | $133.56 | $133.56 | $14.87 | $104.06 | $7.18 | $16.69 | $4,995 | 29 |
NVIDIA A10 24GB | $63.30 | $15.80 | $6.86 | $82.29 | $3.29 | $7.90 | $1,975 | 59 |
NVIDIA L40 48GB | $57.18 | $28.58 | $9.11 | $107.81 | $5.99 | $14.30 | $5,175 | 31 |
AMD Radeon RX 7900 XT 20GB | $15.38 | $7.77 | $4.76 | $40.00 | $1.00 | $7.77 | $800 | 37 |
NVIDIA L4 24GB | $16.99 | $8.43 | $8.50 | $84.96 | $6.80 | $4.20 | $2,039 | 25 |
NVIDIA RTX A5000 24GB | $47.89 | $47.89 | $5.20 | $55.42 | $1.73 | $2.99 | $1,330 | 63 |
NVIDIA A100 PCIe 80GB | $115.38 | $57.69 | $41.66 | $224.99 | $9.30 | $28.84 | $17,999 | 12 |
NVIDIA Tesla P100 16GB | $22.17 | $11.08 | $โ | $14.69 | $0.32 | $โ | $235 | 88 |
NVIDIA RTX 4090 24GB | $29.04 | $7.26 | $4.69 | $99.96 | $2.38 | $3.63 | $2,399 | 93 |
NVIDIA Tesla V100 32GB | $114.29 | $57.14 | $2.50 | $50.00 | $1.78 | $28.57 | $1,600 | 35 |
NVIDIA H100 PCIe 80GB | $29.76 | $14.87 | $49.34 | $281.25 | $11.03 | $7.44 | $22,500 | 12 |
AMD Radeon RX 7900 XTX 24GB | $19.23 | $9.54 | $6.11 | $48.88 | $1.22 | $9.54 | $1,173 | 51 |
NVIDIA L40S 48GB | $40.98 | $20.72 | $13.20 | $156.25 | $8.68 | $5.12 | $7,500 | 33 |
NVIDIA Tesla V100 16GB | $45.71 | $22.86 | $1.00 | $40.00 | $0.71 | $11.43 | $640 | 44 |
AMD Radeon RX 7700 XT 12GB | $16.26 | $8.13 | $5.27 | $47.42 | $1.32 | $โ | $569 | 29 |
AMD Radeon RX 7800 XT 16GB | $17.15 | $8.58 | $5.29 | $39.66 | $1.02 | $โ | $635 | 46 |
AMD Radeon RX 7600 XT 16GB | $17.28 | $8.64 | $6.09 | $24.37 | $1.35 | $โ | $390 | 12 |