GPUs Ranked by Cost per FP32 TFLOPs
Something missing? Let us know and we'll add it if we can.
GPU | $ / FP32 TFLOPs | $ / FP16 TFLOPs | $ / Tensor Core Count | $ / Memory Capacity (GB) | $ / Memory Bandwidth (GB/s) | $ / Int8 TOPs | Minimum Price | Available for Sale |
---|---|---|---|---|---|---|---|---|
NVIDIA T4 16GB | $71.60 | $8.92 | $1.81 | $36.25 | $1.81 | $4.46 | $580 | 84 |
NVIDIA A30 24GB | $17.88 | $17.88 | $13.17 | $122.92 | $3.16 | $8.94 | $2,950 | 46 |
NVIDIA A40 48GB | $114.97 | $114.97 | $12.80 | $89.58 | $6.18 | $14.37 | $4,300 | 37 |
NVIDIA A10 24GB | $35.26 | $8.80 | $3.82 | $45.83 | $1.83 | $4.40 | $1,100 | 70 |
NVIDIA L40 48GB | $56.91 | $28.45 | $9.07 | $107.29 | $5.96 | $14.23 | $5,150 | 27 |
AMD Radeon RX 7900 XT 20GB | $10.67 | $5.39 | $3.30 | $27.75 | $0.69 | $5.39 | $555 | 92 |
NVIDIA L4 24GB | $14.83 | $7.36 | $7.42 | $74.17 | $5.93 | $3.67 | $1,780 | 52 |
NVIDIA RTX A5000 24GB | $50.41 | $50.41 | $5.47 | $58.33 | $1.82 | $3.15 | $1,400 | 70 |
NVIDIA A100 PCIe 80GB | $62.18 | $31.09 | $22.45 | $121.25 | $5.01 | $15.54 | $9,700 | 12 |
NVIDIA Tesla P100 16GB | $9.24 | $4.62 | $โ | $6.12 | $0.13 | $โ | $98 | 100 |
NVIDIA Geforce RTX 4090 24GB | $0.96 | $0.12 | $0.15 | $3.29 | $0.08 | $0.06 | $79 | 100 |
NVIDIA Tesla V100 32GB | $50.00 | $25.00 | $1.09 | $21.87 | $0.78 | $12.50 | $700 | 60 |
NVIDIA H100 PCIe 80GB | $36.46 | $18.22 | $60.45 | $344.58 | $13.52 | $9.11 | $27,566 | 12 |
AMD Radeon RX 7900 XTX 24GB | $10.58 | $5.25 | $3.36 | $26.90 | $0.67 | $5.25 | $645 | 100 |
NVIDIA L40S 48GB | $38.25 | $19.34 | $12.32 | $145.83 | $8.10 | $4.77 | $7,000 | 34 |
NVIDIA Tesla V100 16GB | $20.00 | $10.00 | $0.44 | $17.50 | $0.31 | $5.00 | $280 | 69 |
AMD Radeon RX 7700 XT 12GB | $8.57 | $4.29 | $2.78 | $25.00 | $0.69 | $โ | $300 | 49 |
AMD Radeon RX 7800 XT 16GB | $10.81 | $5.41 | $3.33 | $25.00 | $0.64 | $โ | $400 | 69 |
AMD Radeon RX 7600 XT 16GB | $13.29 | $6.65 | $4.69 | $18.75 | $1.04 | $โ | $300 | 16 |
NVIDIA GeForce RTX 5080 16GB | $8.44 | $2.11 | $2.83 | $59.38 | $0.99 | $1.06 | $950 | 100 |
NVIDIA GeForce RTX 5090 32GB | $11.45 | $2.86 | $3.53 | $74.97 | $1.34 | $1.43 | $2,399 | 100 |
NVIDIA GeForce RTX 5070 Ti 16GB | $6.57 | $1.64 | $2.20 | $46.25 | $0.77 | $0.82 | $740 | 100 |
NVIDIA Geforce RTX 4070 12GB | $7.39 | $1.84 | $2.34 | $35.83 | $0.85 | $0.92 | $430 | 69 |
NVIDIA Geforce RTX 4070 Ti 12GB | $5.54 | $1.39 | $1.85 | $37.04 | $0.88 | $0.69 | $444 | 63 |
NVIDIA Geforce RTX 4080 16GB | $8.01 | $1.96 | $2.57 | $48.75 | $1.09 | $1.00 | $780 | 100 |