GPUs Ranked by Cost per Int8 TOPs
Something missing? Let us know and we'll add it if we can.
GPU | $ / Tensor Core Count | $ / FP32 TFLOPs | $ / FP16 TFLOPs | $ / Int8 TOPs | $ / Memory Capacity (GB) | $ / Memory Bandwidth (GB/s) | Minimum Price | Available for Sale |
---|---|---|---|---|---|---|---|---|
NVIDIA T4 16GB | $1.82 | $71.85 | $8.95 | $4.48 | $36.38 | $1.82 | $582 | 77 |
NVIDIA A30 24GB | $3.21 | $4.36 | $4.36 | $2.18 | $30.00 | $0.77 | $720 | 39 |
NVIDIA A40 48GB | $14.58 | $131.02 | $131.02 | $16.37 | $102.08 | $7.04 | $4,900 | 33 |
NVIDIA A10 24GB | $6.07 | $56.06 | $13.99 | $7.00 | $72.88 | $2.92 | $1,749 | 51 |
NVIDIA L40 48GB | $8.80 | $55.25 | $27.62 | $13.81 | $104.17 | $5.79 | $5,000 | 37 |
AMD Radeon RX 7900 XT 20GB | $3.57 | $11.54 | $5.83 | $5.83 | $30.00 | $0.75 | $600 | 48 |
NVIDIA L4 24GB | $7.50 | $14.99 | $7.43 | $3.71 | $74.96 | $6.00 | $1,799 | 28 |
NVIDIA RTX A5000 24GB | $5.55 | $51.13 | $51.13 | $3.20 | $59.16 | $1.85 | $1,420 | 63 |
NVIDIA A100 PCIe 80GB | $45.14 | $125.00 | $62.50 | $31.25 | $243.75 | $10.08 | $19,500 | 9 |
NVIDIA Tesla P100 16GB | $โ | $16.00 | $8.00 | $โ | $10.60 | $0.23 | $170 | 79 |
NVIDIA RTX 4090 24GB | $1.74 | $10.77 | $2.69 | $1.35 | $37.08 | $0.88 | $890 | 96 |
NVIDIA Tesla V100 32GB | $1.56 | $71.43 | $35.71 | $17.86 | $31.25 | $1.11 | $1,000 | 46 |
AMD Radeon RX 7900 XTX 24GB | $4.01 | $12.62 | $6.26 | $6.26 | $32.08 | $0.80 | $770 | 66 |
NVIDIA H100 PCIe 80GB | $55.48 | $33.47 | $16.72 | $8.36 | $316.25 | $12.41 | $25,300 | 12 |
NVIDIA L40S 48GB | $14.96 | $46.44 | $23.48 | $5.80 | $177.06 | $9.84 | $8,499 | 11 |
NVIDIA Tesla V100 16GB | $1.01 | $46.36 | $23.18 | $11.59 | $40.56 | $0.72 | $649 | 53 |
AMD Radeon RX 7800 XT 16GB | $3.63 | $11.76 | $5.88 | $โ | $27.19 | $0.70 | $435 | 54 |
AMD Radeon RX 7700 XT 12GB | $3.80 | $11.71 | $5.86 | $โ | $34.17 | $0.95 | $410 | 34 |
AMD Radeon RX 7600 XT 16GB | $5.16 | $14.62 | $7.31 | $โ | $20.62 | $1.15 | $330 | 20 |