GPUs Ranked by Cost per Int8 TOPs
Something missing? Let us know and we'll add it if we can.
GPU | $ / FP32 TFLOPs | $ / FP16 TFLOPs | $ / Tensor Core Count | $ / Memory Capacity (GB) | $ / Memory Bandwidth (GB/s) | $ / Int8 TOPs | Minimum Price | Available for Sale |
---|---|---|---|---|---|---|---|---|
NVIDIA T4 16GB | $73.95 | $9.22 | $1.87 | $37.44 | $1.87 | $4.61 | $599 | 84 |
NVIDIA A30 24GB | $13.94 | $13.94 | $10.27 | $95.83 | $2.46 | $6.97 | $2,300 | 46 |
NVIDIA A40 48GB | $120.32 | $120.32 | $13.39 | $93.75 | $6.47 | $15.04 | $4,500 | 28 |
NVIDIA A10 24GB | $49.30 | $12.31 | $5.34 | $64.09 | $2.56 | $6.15 | $1,538 | 63 |
NVIDIA L40 48GB | $58.51 | $29.25 | $9.32 | $110.31 | $6.13 | $14.63 | $5,295 | 28 |
AMD Radeon RX 7900 XT 20GB | $11.52 | $5.82 | $3.57 | $29.95 | $0.75 | $5.82 | $599 | 95 |
NVIDIA L4 24GB | $15.83 | $7.85 | $7.91 | $79.13 | $6.33 | $3.92 | $1,899 | 55 |
NVIDIA RTX A5000 24GB | $46.45 | $46.45 | $5.04 | $53.75 | $1.68 | $2.90 | $1,290 | 88 |
NVIDIA A100 PCIe 80GB | $73.72 | $36.86 | $26.62 | $143.75 | $5.94 | $18.43 | $11,500 | 12 |
NVIDIA Tesla P100 16GB | $12.07 | $6.04 | $โ | $8.00 | $0.17 | $โ | $128 | 100 |
NVIDIA Geforce RTX 4090 24GB | $27.12 | $3.39 | $4.37 | $93.33 | $2.22 | $1.70 | $2,240 | 92 |
NVIDIA Tesla V100 32GB | $77.72 | $38.86 | $1.70 | $34.00 | $1.21 | $19.43 | $1,088 | 42 |
NVIDIA H100 PCIe 80GB | $36.88 | $18.43 | $61.14 | $348.50 | $13.67 | $9.21 | $27,880 | 9 |
AMD Radeon RX 7900 XTX 24GB | $11.48 | $5.69 | $3.65 | $29.17 | $0.73 | $5.69 | $700 | 100 |
NVIDIA L40S 48GB | $43.58 | $22.03 | $14.04 | $166.15 | $9.23 | $5.44 | $7,975 | 28 |
NVIDIA Tesla V100 16GB | $29.29 | $14.64 | $0.64 | $25.63 | $0.46 | $7.32 | $410 | 62 |
AMD Radeon RX 7700 XT 12GB | $10.43 | $5.21 | $3.38 | $30.42 | $0.84 | $โ | $365 | 67 |
AMD Radeon RX 7800 XT 16GB | $12.16 | $6.08 | $3.75 | $28.13 | $0.72 | $โ | $450 | 84 |
AMD Radeon RX 7600 XT 16GB | $14.40 | $7.20 | $5.08 | $20.31 | $1.13 | $โ | $325 | 15 |
NVIDIA GeForce RTX 5080 16GB | $10.90 | $2.73 | $3.65 | $76.72 | $1.28 | $1.36 | $1,228 | 99 |
NVIDIA GeForce RTX 5090 32GB | $11.88 | $2.97 | $3.66 | $77.78 | $1.39 | $1.49 | $2,489 | 96 |
NVIDIA GeForce RTX 5070 Ti 16GB | $7.37 | $1.84 | $2.47 | $51.87 | $0.86 | $0.92 | $830 | 100 |
NVIDIA Geforce RTX 4070 12GB | $8.25 | $2.06 | $2.61 | $40.00 | $0.95 | $1.03 | $480 | 99 |
NVIDIA Geforce RTX 4070 Ti 12GB | $9.03 | $2.26 | $3.02 | $60.38 | $1.44 | $1.13 | $725 | 32 |
NVIDIA Geforce RTX 4080 16GB | $9.23 | $2.25 | $2.96 | $56.19 | $1.25 | $1.15 | $899 | 97 |