GPUs Ranked by Cost per FP16 TFLOPs
Something missing? Let us know and we'll add it if we can.
| GPU | $ / FP32 TFLOPs | $ / FP16 TFLOPs | $ / Tensor Core Count | $ / Memory Capacity (GB) | $ / Memory Bandwidth (GB/s) | $ / Int8 TOPs | Minimum Price | Available for Sale |
|---|---|---|---|---|---|---|---|---|
| NVIDIA GeForce RTX 5070 Ti 16GB | $7.90 | $1.98 | $2.65 | $55.62 | $0.93 | $0.99 | $890 | 98 |
| NVIDIA Geforce RTX 4070 Ti 12GB | $8.23 | $2.06 | $2.75 | $55.00 | $1.31 | $1.03 | $660 | 48 |
| NVIDIA Geforce RTX 4070 12GB | $8.76 | $2.19 | $2.77 | $42.50 | $1.01 | $1.09 | $510 | 67 |
| NVIDIA Geforce RTX 4080 16GB | $9.25 | $2.26 | $2.96 | $56.32 | $1.26 | $1.16 | $901 | 89 |
| NVIDIA GeForce RTX 5080 16GB | $10.20 | $2.55 | $3.42 | $71.81 | $1.20 | $1.28 | $1,149 | 99 |
| NVIDIA GeForce RTX 5090 32GB | $12.61 | $3.15 | $3.89 | $82.58 | $1.47 | $1.58 | $2,642 | 100 |
| NVIDIA Geforce RTX 4090 24GB | $25.41 | $3.18 | $4.10 | $87.46 | $2.08 | $1.59 | $2,099 | 99 |
| AMD Radeon RX 7700 XT 12GB | $12.57 | $6.29 | $4.07 | $36.66 | $1.02 | $∞ | $440 | 41 |
| AMD Radeon RX 7900 XT 20GB | $12.69 | $6.41 | $3.93 | $33.00 | $0.82 | $6.41 | $660 | 71 |
| AMD Radeon RX 7900 XTX 24GB | $13.11 | $6.50 | $4.17 | $33.33 | $0.83 | $6.50 | $800 | 100 |
| AMD Radeon RX 7800 XT 16GB | $14.73 | $7.36 | $4.54 | $34.06 | $0.87 | $∞ | $545 | 64 |
| NVIDIA Tesla P100 16GB | $15.57 | $7.78 | $∞ | $10.31 | $0.23 | $∞ | $165 | 100 |
| NVIDIA L4 24GB | $17.32 | $8.59 | $8.66 | $86.58 | $6.93 | $4.28 | $2,078 | 40 |
| NVIDIA T4 16GB | $70.99 | $8.85 | $1.80 | $35.94 | $1.80 | $4.42 | $575 | 80 |
| AMD Radeon RX 7600 XT 16GB | $19.05 | $9.53 | $6.72 | $26.87 | $1.49 | $∞ | $430 | 10 |
| NVIDIA A10 24GB | $41.63 | $10.39 | $4.51 | $54.13 | $2.17 | $5.20 | $1,299 | 65 |
| NVIDIA A30 24GB | $15.15 | $15.15 | $11.16 | $104.17 | $2.68 | $7.58 | $2,500 | 35 |
| NVIDIA Tesla V100 16GB | $35.71 | $17.86 | $0.78 | $31.25 | $0.56 | $8.93 | $500 | 54 |
| NVIDIA H100 PCIe 80GB | $38.96 | $19.46 | $64.58 | $368.13 | $14.44 | $9.73 | $29,450 | 8 |
| NVIDIA L40S 48GB | $44.72 | $22.60 | $14.41 | $170.48 | $9.47 | $5.58 | $8,183 | 25 |
| NVIDIA L40 48GB | $60.77 | $30.38 | $9.68 | $114.58 | $6.37 | $15.19 | $5,500 | 26 |
| NVIDIA Tesla V100 32GB | $90.00 | $45.00 | $1.97 | $39.37 | $1.40 | $22.50 | $1,260 | 32 |
| NVIDIA RTX A5000 24GB | $46.78 | $46.78 | $5.07 | $54.13 | $1.69 | $2.92 | $1,299 | 73 |
| NVIDIA A100 PCIe 80GB | $102.56 | $51.28 | $37.03 | $199.99 | $8.27 | $25.64 | $15,999 | 17 |
| NVIDIA A40 48GB | $160.43 | $160.43 | $17.86 | $125.00 | $8.62 | $20.05 | $6,000 | 29 |