GPUs Ranked by Cost per FP16 TFLOPs
Something missing? Let us know and we'll add it if we can.
| GPU | $ / Tensor Core Count | $ / FP32 TFLOPs | $ / FP16 TFLOPs | $ / Int8 TOPs | $ / Memory Capacity (GB) | $ / Memory Bandwidth (GB/s) | Minimum Price | Available for Sale |
|---|---|---|---|---|---|---|---|---|
| NVIDIA T4 16GB | $1.84 | $72.59 | $9.05 | $4.52 | $36.75 | $1.84 | $588 | 70 |
| NVIDIA A30 24GB | $17.85 | $24.24 | $24.24 | $12.12 | $166.63 | $4.28 | $3,999 | 20 |
| NVIDIA A40 48GB | $14.99 | $134.65 | $134.65 | $16.83 | $104.92 | $7.24 | $5,036 | 19 |
| NVIDIA A10 24GB | $6.07 | $56.06 | $13.99 | $7.00 | $72.88 | $2.92 | $1,749 | 26 |
| NVIDIA L40 48GB | $15.84 | $99.39 | $49.68 | $24.85 | $187.40 | $10.41 | $8,995 | 25 |
| AMD Radeon RX 7900 XT 20GB | $3.69 | $11.92 | $6.02 | $6.02 | $31.00 | $0.78 | $620 | 42 |
| NVIDIA L4 24GB | $12.48 | $24.97 | $12.38 | $6.18 | $124.85 | $9.99 | $2,996 | 8 |
| NVIDIA RTX A5000 24GB | $5.38 | $49.58 | $49.58 | $3.10 | $57.37 | $1.79 | $1,377 | 52 |
| NVIDIA A100 PCIe 80GB | $33.56 | $92.95 | $46.47 | $23.24 | $181.25 | $7.49 | $14,500 | 13 |
| NVIDIA Tesla P100 16GB | $∞ | $14.06 | $7.03 | $∞ | $9.31 | $0.20 | $149 | 73 |
| NVIDIA RTX 4090 24GB | $3.12 | $19.37 | $4.84 | $2.42 | $66.66 | $1.59 | $1,600 | 99 |
| NVIDIA Tesla V100 32GB | $4.41 | $201.43 | $100.71 | $50.36 | $88.13 | $3.13 | $2,820 | 25 |
| AMD Radeon RX 7900 XTX 24GB | $4.11 | $12.93 | $6.41 | $6.41 | $32.88 | $0.82 | $789 | 61 |
| NVIDIA H100 PCIe 80GB | $63.60 | $38.36 | $19.17 | $9.58 | $362.50 | $14.22 | $29,000 | 9 |
| NVIDIA L40S 48GB | $23.09 | $71.68 | $36.24 | $8.95 | $273.28 | $15.18 | $13,118 | 6 |
| NVIDIA Tesla V100 16GB | $1.23 | $56.43 | $28.21 | $14.11 | $49.38 | $0.88 | $790 | 36 |
| AMD Radeon RX 7800 XT 16GB | $3.67 | $11.89 | $5.95 | $∞ | $27.50 | $0.71 | $440 | 49 |
| AMD Radeon RX 7700 XT 12GB | $4.07 | $12.57 | $6.29 | $∞ | $36.67 | $1.02 | $440 | 31 |
| AMD Radeon RX 7600 XT 16GB | $5.16 | $14.62 | $7.31 | $∞ | $20.62 | $1.15 | $330 | 17 |