GPUs Ranked by Cost per Int8 TOPs
Something missing? Let us know and we'll add it if we can.
GPU | $ / Tensor Core Count | $ / FP32 TFLOPs | $ / FP16 TFLOPs | $ / Int8 TOPs | $ / Memory Capacity (GB) | $ / Memory Bandwidth (GB/s) | Minimum Price | Available for Sale |
---|---|---|---|---|---|---|---|---|
NVIDIA T4 16GB | $1.82 | $71.85 | $8.95 | $4.48 | $36.38 | $1.82 | $582 | 85 |
NVIDIA A30 24GB | $12.95 | $17.58 | $17.58 | $8.79 | $120.83 | $3.11 | $2,900 | 37 |
NVIDIA A40 48GB | $13.39 | $120.32 | $120.32 | $15.04 | $93.75 | $6.47 | $4,500 | 35 |
NVIDIA A10 24GB | $6.07 | $56.06 | $13.99 | $7.00 | $72.88 | $2.92 | $1,749 | 51 |
NVIDIA L40 48GB | $8.80 | $55.25 | $27.62 | $13.81 | $104.17 | $5.79 | $5,000 | 39 |
AMD Radeon RX 7900 XT 20GB | $3.51 | $11.35 | $5.73 | $5.73 | $29.50 | $0.74 | $590 | 48 |
NVIDIA L4 24GB | $7.50 | $14.99 | $7.43 | $3.71 | $74.96 | $6.00 | $1,799 | 29 |
NVIDIA RTX A5000 24GB | $5.48 | $50.55 | $50.55 | $3.16 | $58.49 | $1.83 | $1,404 | 59 |
NVIDIA A100 PCIe 80GB | $45.14 | $125.00 | $62.50 | $31.25 | $243.75 | $10.08 | $19,500 | 9 |
NVIDIA Tesla P100 16GB | $โ | $16.00 | $8.00 | $โ | $10.60 | $0.23 | $170 | 78 |
NVIDIA RTX 4090 24GB | $1.70 | $10.53 | $2.63 | $1.32 | $36.25 | $0.86 | $870 | 97 |
NVIDIA Tesla V100 32GB | $1.87 | $85.71 | $42.86 | $21.43 | $37.50 | $1.33 | $1,200 | 48 |
AMD Radeon RX 7900 XTX 24GB | $3.80 | $11.97 | $5.93 | $5.93 | $30.42 | $0.76 | $730 | 56 |
NVIDIA H100 PCIe 80GB | $31.91 | $19.25 | $9.62 | $4.81 | $181.88 | $7.14 | $14,550 | 10 |
NVIDIA L40S 48GB | $14.96 | $46.44 | $23.48 | $5.80 | $177.06 | $9.84 | $8,499 | 10 |
NVIDIA Tesla V100 16GB | $1.01 | $46.36 | $23.18 | $11.59 | $40.56 | $0.72 | $649 | 55 |
AMD Radeon RX 7800 XT 16GB | $3.63 | $11.76 | $5.88 | $โ | $27.19 | $0.70 | $435 | 50 |
AMD Radeon RX 7700 XT 12GB | $4.34 | $13.38 | $6.69 | $โ | $39.03 | $1.08 | $468 | 32 |
AMD Radeon RX 7600 XT 16GB | $5.00 | $14.18 | $7.09 | $โ | $20.00 | $1.11 | $320 | 21 |