GPUs Ranked by Cost per FP16 TFLOPs
Something missing? Let us know and we'll add it if we can.
| GPU | $ / Tensor Core Count | $ / FP32 TFLOPs | $ / FP16 TFLOPs | $ / Int8 TOPs | $ / Memory Capacity (GB) | $ / Memory Bandwidth (GB/s) | Minimum Price | Available for Sale |
|---|---|---|---|---|---|---|---|---|
| NVIDIA T4 16GB | $1.72 | $67.90 | $8.46 | $4.23 | $34.37 | $1.72 | $550 | 82 |
| NVIDIA A30 24GB | $12.28 | $16.67 | $16.67 | $8.33 | $114.57 | $2.95 | $2,750 | 39 |
| NVIDIA A40 48GB | $14.73 | $132.35 | $132.35 | $16.54 | $103.13 | $7.11 | $4,950 | 30 |
| NVIDIA A10 24GB | $6.07 | $56.06 | $13.99 | $7.00 | $72.88 | $2.92 | $1,749 | 52 |
| NVIDIA L40 48GB | $10.12 | $63.54 | $31.76 | $15.88 | $119.79 | $6.66 | $5,750 | 42 |
| AMD Radeon RX 7900 XT 20GB | $3.57 | $11.54 | $5.83 | $5.83 | $30.00 | $0.75 | $600 | 37 |
| NVIDIA L4 24GB | $7.50 | $14.99 | $7.43 | $3.71 | $74.96 | $6.00 | $1,799 | 32 |
| NVIDIA RTX A5000 24GB | $5.46 | $50.38 | $50.38 | $3.15 | $58.29 | $1.82 | $1,399 | 62 |
| NVIDIA A100 PCIe 80GB | $43.80 | $121.28 | $60.64 | $30.32 | $236.50 | $9.78 | $18,920 | 12 |
| NVIDIA Tesla P100 16GB | $∞ | $14.15 | $7.08 | $∞ | $9.38 | $0.20 | $150 | 75 |
| NVIDIA RTX 4090 24GB | $1.56 | $9.67 | $2.42 | $1.21 | $33.29 | $0.79 | $799 | 96 |
| NVIDIA Tesla V100 32GB | $1.09 | $49.93 | $24.96 | $12.48 | $21.84 | $0.78 | $699 | 43 |
| AMD Radeon RX 7900 XTX 24GB | $1.05 | $3.30 | $1.63 | $1.63 | $8.38 | $0.21 | $201 | 46 |
| NVIDIA H100 PCIe 80GB | $55.48 | $33.47 | $16.72 | $8.36 | $316.25 | $12.41 | $25,300 | 14 |
| NVIDIA L40S 48GB | $13.20 | $40.98 | $20.72 | $5.12 | $156.25 | $8.68 | $7,500 | 21 |
| NVIDIA Tesla V100 16GB | $1.01 | $46.07 | $23.04 | $11.52 | $40.31 | $0.72 | $645 | 45 |
| AMD Radeon RX 7800 XT 16GB | $4.73 | $15.35 | $7.68 | $∞ | $35.51 | $0.91 | $568 | 36 |
| AMD Radeon RX 7700 XT 12GB | $4.17 | $12.86 | $6.43 | $∞ | $37.50 | $1.04 | $450 | 31 |
| AMD Radeon RX 7600 XT 16GB | $6.61 | $18.75 | $9.37 | $∞ | $26.45 | $1.47 | $423 | 15 |