GPUs Ranked by Cost per FP16 TFLOPs
Something missing? Let us know and we'll add it if we can.
| GPU | $ / FP32 TFLOPs | $ / FP16 TFLOPs | $ / Tensor Core Count | $ / Memory Capacity (GB) | $ / Memory Bandwidth (GB/s) | $ / Int8 TOPs | Minimum Price | Available for Sale |
|---|---|---|---|---|---|---|---|---|
| NVIDIA T4 16GB | $80.25 | $10.00 | $2.03 | $40.63 | $2.03 | $5.00 | $650 | 69 |
| NVIDIA A30 24GB | $17.88 | $17.88 | $13.17 | $122.92 | $3.16 | $8.94 | $2,950 | 34 |
| NVIDIA A40 48GB | $120.32 | $120.32 | $13.39 | $93.75 | $6.47 | $15.04 | $4,500 | 28 |
| NVIDIA A10 24GB | $63.11 | $15.75 | $6.84 | $82.05 | $3.28 | $7.88 | $1,969 | 61 |
| NVIDIA L40 48GB | $60.54 | $30.26 | $9.65 | $114.15 | $6.34 | $15.14 | $5,479 | 30 |
| AMD Radeon RX 7900 XT 20GB | $16.25 | $8.20 | $5.03 | $42.25 | $1.06 | $8.20 | $845 | 36 |
| NVIDIA L4 24GB | $15.83 | $7.85 | $7.92 | $79.17 | $6.33 | $3.92 | $1,900 | 27 |
| NVIDIA RTX A5000 24GB | $47.89 | $47.89 | $5.20 | $55.42 | $1.73 | $2.99 | $1,330 | 61 |
| NVIDIA A100 PCIe 80GB | $115.38 | $57.69 | $41.66 | $224.99 | $9.30 | $28.84 | $17,999 | 12 |
| NVIDIA Tesla P100 16GB | $18.87 | $9.43 | $∞ | $12.50 | $0.27 | $∞ | $200 | 87 |
| NVIDIA RTX 4090 24GB | $28.09 | $7.02 | $4.53 | $96.67 | $2.30 | $3.51 | $2,320 | 92 |
| NVIDIA Tesla V100 32GB | $128.57 | $64.29 | $2.81 | $56.25 | $2.00 | $32.14 | $1,800 | 33 |
| NVIDIA H100 PCIe 80GB | $29.76 | $14.87 | $49.34 | $281.25 | $11.03 | $7.44 | $22,500 | 13 |
| AMD Radeon RX 7900 XTX 24GB | $18.03 | $8.94 | $5.73 | $45.83 | $1.15 | $8.94 | $1,100 | 70 |
| NVIDIA L40S 48GB | $38.52 | $19.48 | $12.41 | $146.87 | $8.16 | $4.81 | $7,050 | 30 |
| NVIDIA Tesla V100 16GB | $45.71 | $22.86 | $1.00 | $40.00 | $0.71 | $11.43 | $640 | 43 |
| AMD Radeon RX 7700 XT 12GB | $12.57 | $6.29 | $4.07 | $36.67 | $1.02 | $∞ | $440 | 31 |
| AMD Radeon RX 7800 XT 16GB | $17.16 | $8.58 | $5.29 | $39.69 | $1.02 | $∞ | $635 | 46 |
| AMD Radeon RX 7600 XT 16GB | $20.10 | $10.05 | $7.09 | $28.35 | $1.58 | $∞ | $454 | 10 |