GPUs Ranked by Cost per Int8 TOPs
Something missing? Let us know and we'll add it if we can.
GPU | $ / FP32 TFLOPs | $ / FP16 TFLOPs | $ / Tensor Core Count | $ / Memory Capacity (GB) | $ / Memory Bandwidth (GB/s) | $ / Int8 TOPs | Minimum Price | Available for Sale |
---|---|---|---|---|---|---|---|---|
NVIDIA T4 16GB | $64.20 | $8.00 | $1.63 | $32.50 | $1.63 | $4.00 | $520 | 85 |
NVIDIA A30 24GB | $14.55 | $14.55 | $10.71 | $100.00 | $2.57 | $7.27 | $2,400 | 34 |
NVIDIA A40 48GB | $160.43 | $160.43 | $17.86 | $125.00 | $8.62 | $20.05 | $6,000 | 27 |
NVIDIA A10 24GB | $41.63 | $10.39 | $4.51 | $54.13 | $2.17 | $5.20 | $1,299 | 66 |
NVIDIA L40 48GB | $49.72 | $24.85 | $7.92 | $93.75 | $5.21 | $12.43 | $4,500 | 28 |
AMD Radeon RX 7900 XT 20GB | $12.48 | $6.30 | $3.86 | $32.45 | $0.81 | $6.30 | $649 | 78 |
NVIDIA L4 24GB | $17.27 | $8.56 | $8.63 | $86.33 | $6.91 | $4.27 | $2,072 | 47 |
NVIDIA RTX A5000 24GB | $55.82 | $55.82 | $6.05 | $64.58 | $2.02 | $3.49 | $1,550 | 72 |
NVIDIA A100 PCIe 80GB | $76.92 | $38.46 | $27.78 | $149.99 | $6.20 | $19.23 | $11,999 | 11 |
NVIDIA Tesla P100 16GB | $14.15 | $7.07 | $โ | $9.37 | $0.20 | $โ | $150 | 100 |
NVIDIA Geforce RTX 4090 24GB | $25.73 | $3.22 | $4.15 | $88.54 | $2.11 | $1.61 | $2,125 | 99 |
NVIDIA Tesla V100 32GB | $114.29 | $57.14 | $2.50 | $50.00 | $1.78 | $28.57 | $1,600 | 38 |
NVIDIA H100 PCIe 80GB | $33.07 | $16.52 | $54.82 | $312.49 | $12.26 | $8.26 | $24,999 | 8 |
AMD Radeon RX 7900 XTX 24GB | $11.48 | $5.69 | $3.65 | $29.17 | $0.73 | $5.69 | $700 | 100 |
NVIDIA L40S 48GB | $44.72 | $22.60 | $14.41 | $170.48 | $9.47 | $5.58 | $8,183 | 25 |
NVIDIA Tesla V100 16GB | $30.36 | $15.18 | $0.66 | $26.56 | $0.47 | $7.59 | $425 | 58 |
AMD Radeon RX 7700 XT 12GB | $11.43 | $5.71 | $3.70 | $33.33 | $0.93 | $โ | $400 | 50 |
AMD Radeon RX 7800 XT 16GB | $13.25 | $6.63 | $4.09 | $30.65 | $0.79 | $โ | $490 | 64 |
AMD Radeon RX 7600 XT 16GB | $17.72 | $8.86 | $6.25 | $25.00 | $1.39 | $โ | $400 | 10 |
NVIDIA GeForce RTX 5080 16GB | $10.92 | $2.73 | $3.66 | $76.87 | $1.28 | $1.37 | $1,230 | 100 |
NVIDIA GeForce RTX 5090 32GB | $12.39 | $3.10 | $3.82 | $81.13 | $1.45 | $1.55 | $2,596 | 98 |
NVIDIA GeForce RTX 5070 Ti 16GB | $7.50 | $1.88 | $2.51 | $52.78 | $0.88 | $0.94 | $845 | 100 |
NVIDIA Geforce RTX 4070 12GB | $8.85 | $2.21 | $2.80 | $42.92 | $1.02 | $1.10 | $515 | 75 |
NVIDIA Geforce RTX 4070 Ti 12GB | $8.48 | $2.12 | $2.83 | $56.67 | $1.35 | $1.06 | $680 | 52 |
NVIDIA Geforce RTX 4080 16GB | $8.98 | $2.19 | $2.88 | $54.69 | $1.22 | $1.12 | $875 | 96 |