GPUs Ranked by Cost per FP32 TFLOPs
Something missing? Let us know and we'll add it if we can.
| GPU | $ / FP32 TFLOPs | $ / FP16 TFLOPs | $ / Tensor Core Count | $ / Memory Capacity (GB) | $ / Memory Bandwidth (GB/s) | $ / Int8 TOPs | Minimum Price | Available for Sale |
|---|---|---|---|---|---|---|---|---|
| NVIDIA T4 16GB | $61.73 | $7.69 | $1.56 | $31.25 | $1.56 | $3.85 | $500 | 62 |
| NVIDIA A30 24GB | $18.15 | $18.15 | $13.37 | $124.79 | $3.21 | $9.08 | $2,995 | 31 |
| NVIDIA A40 48GB | $127.08 | $127.08 | $14.15 | $99.02 | $6.83 | $15.88 | $4,753 | 23 |
| NVIDIA A10 24GB | $59.55 | $14.86 | $6.45 | $77.41 | $3.10 | $7.43 | $1,858 | 51 |
| NVIDIA L40 48GB | $60.62 | $30.30 | $9.66 | $114.29 | $6.35 | $15.15 | $5,486 | 24 |
| AMD Radeon RX 7900 XT 20GB | $13.46 | $6.80 | $4.17 | $35.00 | $0.88 | $6.80 | $700 | 44 |
| NVIDIA L4 24GB | $17.92 | $8.88 | $8.96 | $89.58 | $7.17 | $4.43 | $2,150 | 29 |
| NVIDIA RTX A5000 24GB | $45.01 | $45.01 | $4.88 | $52.08 | $1.63 | $2.81 | $1,250 | 67 |
| NVIDIA A100 PCIe 80GB | $108.97 | $54.48 | $39.35 | $212.49 | $8.79 | $27.24 | $16,999 | 9 |
| NVIDIA Tesla P100 16GB | $22.17 | $11.08 | $∞ | $14.69 | $0.32 | $∞ | $235 | 77 |
| NVIDIA RTX 4090 24GB | $22.40 | $5.60 | $3.61 | $77.08 | $1.84 | $2.80 | $1,850 | 20 |
| NVIDIA Tesla V100 32GB | $71.36 | $35.68 | $1.56 | $31.22 | $1.11 | $17.84 | $999 | 35 |
| NVIDIA H100 PCIe 80GB | $38.35 | $19.16 | $63.59 | $362.44 | $14.22 | $9.58 | $28,995 | 10 |
| AMD Radeon RX 7900 XTX 24GB | $14.43 | $7.15 | $4.58 | $36.67 | $0.92 | $7.15 | $880 | 48 |
| NVIDIA L40S 48GB | $40.71 | $20.58 | $13.12 | $155.21 | $8.62 | $5.08 | $7,450 | 27 |
| NVIDIA Tesla V100 16GB | $42.86 | $21.43 | $0.94 | $37.50 | $0.67 | $10.71 | $600 | 27 |
| AMD Radeon RX 7700 XT 12GB | $12.14 | $6.07 | $3.94 | $35.42 | $0.98 | $∞ | $425 | 29 |
| AMD Radeon RX 7800 XT 16GB | $15.32 | $7.66 | $4.72 | $35.42 | $0.91 | $∞ | $567 | 38 |
| AMD Radeon RX 7600 XT 16GB | $14.85 | $7.42 | $5.24 | $20.95 | $1.16 | $∞ | $335 | 15 |