GPUs Ranked by Cost per Memory Capacity (GB)
Something missing? Let us know and we'll add it if we can.
GPU | $ / FP32 TFLOPs | $ / FP16 TFLOPs | $ / Tensor Core Count | $ / Memory Capacity (GB) | $ / Memory Bandwidth (GB/s) | $ / Int8 TOPs | Minimum Price | Available for Sale |
---|---|---|---|---|---|---|---|---|
NVIDIA T4 16GB | $70.37 | $8.77 | $1.78 | $35.62 | $1.78 | $4.38 | $570 | 92 |
NVIDIA A30 24GB | $15.15 | $15.15 | $11.16 | $104.17 | $2.68 | $7.58 | $2,500 | 35 |
NVIDIA A40 48GB | $181.82 | $181.82 | $20.24 | $141.67 | $9.77 | $22.72 | $6,800 | 27 |
NVIDIA A10 24GB | $41.63 | $10.39 | $4.51 | $54.13 | $2.17 | $5.20 | $1,299 | 65 |
NVIDIA L40 48GB | $52.49 | $26.24 | $8.36 | $98.96 | $5.50 | $13.12 | $4,750 | 51 |
AMD Radeon RX 7900 XT 20GB | $12.50 | $6.31 | $3.87 | $32.50 | $0.81 | $6.31 | $650 | 72 |
NVIDIA L4 24GB | $17.32 | $8.59 | $8.66 | $86.58 | $6.93 | $4.28 | $2,078 | 39 |
NVIDIA RTX A5000 24GB | $43.21 | $43.21 | $4.69 | $50.00 | $1.56 | $2.70 | $1,200 | 77 |
NVIDIA A100 PCIe 80GB | $102.56 | $51.28 | $37.03 | $199.99 | $8.27 | $25.64 | $15,999 | 11 |
NVIDIA Tesla P100 16GB | $16.51 | $8.25 | $โ | $10.94 | $0.24 | $โ | $175 | 100 |
NVIDIA Geforce RTX 4090 24GB | $26.03 | $3.25 | $4.20 | $89.58 | $2.13 | $1.63 | $2,150 | 100 |
NVIDIA Tesla V100 32GB | $100.00 | $50.00 | $2.19 | $43.75 | $1.56 | $25.00 | $1,400 | 26 |
NVIDIA H100 PCIe 80GB | $38.96 | $19.46 | $64.58 | $368.13 | $14.44 | $9.73 | $29,450 | 8 |
AMD Radeon RX 7900 XTX 24GB | $13.93 | $6.91 | $4.43 | $35.42 | $0.89 | $6.91 | $850 | 100 |
NVIDIA L40S 48GB | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 |
NVIDIA Tesla V100 16GB | $35.71 | $17.86 | $0.78 | $31.25 | $0.56 | $8.93 | $500 | 54 |
AMD Radeon RX 7700 XT 12GB | $12.86 | $6.43 | $4.17 | $37.50 | $1.04 | $โ | $450 | 43 |
AMD Radeon RX 7800 XT 16GB | $14.32 | $7.16 | $4.42 | $33.13 | $0.85 | $โ | $530 | 59 |
AMD Radeon RX 7600 XT 16GB | $19.05 | $9.53 | $6.72 | $26.87 | $1.49 | $โ | $430 | 10 |
NVIDIA GeForce RTX 5080 16GB | $10.66 | $2.67 | $3.57 | $75.00 | $1.25 | $1.33 | $1,200 | 98 |
NVIDIA GeForce RTX 5090 32GB | $13.26 | $3.32 | $4.09 | $86.83 | $1.55 | $1.66 | $2,779 | 100 |
NVIDIA GeForce RTX 5070 Ti 16GB | $7.99 | $2.00 | $2.68 | $56.25 | $0.94 | $1.00 | $900 | 100 |
NVIDIA Geforce RTX 4070 12GB | $8.59 | $2.14 | $2.72 | $41.67 | $0.99 | $1.07 | $500 | 68 |
NVIDIA Geforce RTX 4070 Ti 12GB | $8.23 | $2.06 | $2.75 | $55.00 | $1.31 | $1.03 | $660 | 42 |
NVIDIA Geforce RTX 4080 16GB | $9.24 | $2.26 | $2.96 | $56.25 | $1.26 | $1.15 | $900 | 92 |