GPUs Ranked by Cost per FP32 TFLOPs
Something missing? Let us know and we'll add it if we can.
GPU | $ / FP32 TFLOPs | $ / FP16 TFLOPs | $ / Tensor Core Count | $ / Memory Capacity (GB) | $ / Memory Bandwidth (GB/s) | $ / Int8 TOPs | Minimum Price | Available for Sale |
---|---|---|---|---|---|---|---|---|
NVIDIA T4 16GB | $73.95 | $9.22 | $1.87 | $37.44 | $1.87 | $4.61 | $599 | 91 |
NVIDIA A30 24GB | $19.99 | $19.99 | $14.73 | $137.46 | $3.53 | $10.00 | $3,299 | 41 |
NVIDIA A40 48GB | $120.32 | $120.32 | $13.39 | $93.75 | $6.47 | $15.04 | $4,500 | 31 |
NVIDIA A10 24GB | $44.84 | $11.19 | $4.86 | $58.29 | $2.33 | $5.60 | $1,399 | 68 |
NVIDIA L40 48GB | $60.22 | $30.10 | $9.60 | $113.54 | $6.31 | $15.06 | $5,450 | 27 |
AMD Radeon RX 7900 XT 20GB | $11.33 | $5.72 | $3.51 | $29.45 | $0.74 | $5.72 | $589 | 91 |
NVIDIA L4 24GB | $15.63 | $7.75 | $7.81 | $78.13 | $6.25 | $3.87 | $1,875 | 52 |
NVIDIA RTX A5000 24GB | $46.74 | $46.74 | $5.07 | $54.08 | $1.69 | $2.92 | $1,298 | 78 |
NVIDIA A100 PCIe 80GB | $66.99 | $33.49 | $24.19 | $130.63 | $5.40 | $16.75 | $10,450 | 10 |
NVIDIA Tesla P100 16GB | $9.55 | $4.78 | $โ | $6.33 | $0.14 | $โ | $101 | 100 |
NVIDIA Geforce RTX 4090 24GB | $24.82 | $3.10 | $4.00 | $85.42 | $2.03 | $1.55 | $2,050 | 99 |
NVIDIA Tesla V100 32GB | $77.00 | $38.50 | $1.68 | $33.69 | $1.20 | $19.25 | $1,078 | 50 |
NVIDIA H100 PCIe 80GB | $36.87 | $18.42 | $61.12 | $348.38 | $13.67 | $9.21 | $27,870 | 9 |
AMD Radeon RX 7900 XTX 24GB | $11.80 | $5.85 | $3.75 | $30.00 | $0.75 | $5.85 | $720 | 100 |
NVIDIA L40S 48GB | $39.89 | $20.17 | $12.85 | $152.08 | $8.45 | $4.98 | $7,300 | 30 |
NVIDIA Tesla V100 16GB | $26.93 | $13.47 | $0.59 | $23.57 | $0.42 | $6.73 | $377 | 62 |
AMD Radeon RX 7700 XT 12GB | $9.86 | $4.93 | $3.19 | $28.75 | $0.80 | $โ | $345 | 59 |
AMD Radeon RX 7800 XT 16GB | $12.70 | $6.35 | $3.92 | $29.38 | $0.75 | $โ | $470 | 77 |
AMD Radeon RX 7600 XT 16GB | $13.29 | $6.65 | $4.69 | $18.75 | $1.04 | $โ | $300 | 21 |
NVIDIA GeForce RTX 5080 16GB | $8.88 | $2.22 | $2.98 | $62.50 | $1.04 | $1.11 | $1,000 | 100 |
NVIDIA GeForce RTX 5090 32GB | $10.97 | $2.74 | $3.38 | $71.84 | $1.28 | $1.37 | $2,299 | 100 |
NVIDIA GeForce RTX 5070 Ti 16GB | $7.45 | $1.86 | $2.50 | $52.44 | $0.87 | $0.93 | $839 | 97 |
NVIDIA Geforce RTX 4070 12GB | $8.33 | $2.08 | $2.64 | $40.42 | $0.96 | $1.04 | $485 | 97 |
NVIDIA Geforce RTX 4070 Ti 12GB | $7.22 | $1.80 | $2.41 | $48.25 | $1.15 | $0.90 | $579 | 28 |
NVIDIA Geforce RTX 4080 16GB | $8.73 | $2.13 | $2.80 | $53.13 | $1.19 | $1.09 | $850 | 99 |