GPUs Ranked by Cost per FP32 TFLOPs
Something missing? Let us know and we'll add it if we can.
| GPU | $ / Tensor Core Count | $ / FP32 TFLOPs | $ / FP16 TFLOPs | $ / Int8 TOPs | $ / Memory Capacity (GB) | $ / Memory Bandwidth (GB/s) | Minimum Price | Available for Sale |
|---|---|---|---|---|---|---|---|---|
| NVIDIA T4 16GB | $1.56 | $61.60 | $7.68 | $3.84 | $31.19 | $1.56 | $499 | 100 |
| NVIDIA A30 24GB | $17.19 | $23.33 | $23.33 | $11.67 | $160.42 | $4.13 | $3,850 | 29 |
| NVIDIA A40 48GB | $13.99 | $125.64 | $125.64 | $15.70 | $97.90 | $6.75 | $4,699 | 27 |
| NVIDIA A10 24GB | $4.82 | $44.52 | $11.11 | $5.56 | $57.88 | $2.32 | $1,389 | 38 |
| NVIDIA L40 48GB | $9.67 | $60.72 | $30.35 | $15.18 | $114.48 | $6.36 | $5,495 | 34 |
| AMD Radeon RX 7900 XT 20GB | $3.39 | $10.96 | $5.53 | $5.53 | $28.50 | $0.71 | $570 | 49 |
| NVIDIA L4 24GB | $7.50 | $14.99 | $7.43 | $3.71 | $74.96 | $6.00 | $1,799 | 24 |
| NVIDIA RTX A5000 24GB | $4.88 | $45.01 | $45.01 | $2.81 | $52.08 | $1.63 | $1,250 | 53 |
| NVIDIA A100 PCIe 80GB | $38.77 | $107.37 | $53.68 | $26.84 | $209.36 | $8.66 | $16,749 | 11 |
| NVIDIA Tesla P100 16GB | $∞ | $14.06 | $7.03 | $∞ | $9.31 | $0.20 | $149 | 92 |
| NVIDIA RTX 4090 24GB | $3.51 | $21.73 | $5.43 | $2.72 | $74.79 | $1.78 | $1,795 | 99 |
| NVIDIA Tesla V100 32GB | $2.49 | $113.93 | $56.96 | $28.48 | $49.84 | $1.77 | $1,595 | 47 |
| AMD Radeon RX 7900 XTX 24GB | $0.26 | $0.82 | $0.41 | $0.41 | $2.08 | $0.05 | $50 | 60 |
| NVIDIA H100 PCIe 80GB | $55.92 | $33.73 | $16.85 | $8.43 | $318.75 | $12.51 | $25,500 | 9 |
| NVIDIA L40S 48GB | $10.48 | $32.51 | $16.44 | $4.06 | $123.96 | $6.89 | $5,950 | 12 |
| NVIDIA Tesla V100 16GB | $1.01 | $46.36 | $23.18 | $11.59 | $40.56 | $0.72 | $649 | 39 |
| AMD Radeon RX 7800 XT 16GB | $3.83 | $12.43 | $6.22 | $∞ | $28.75 | $0.74 | $460 | 56 |
| AMD Radeon RX 7700 XT 12GB | $3.23 | $9.98 | $4.99 | $∞ | $29.11 | $0.81 | $349 | 36 |
| AMD Radeon RX 7600 XT 16GB | $5.92 | $16.80 | $8.40 | $∞ | $23.70 | $1.32 | $379 | 18 |