GPUs Ranked by Cost per Int8 TOPs
Something missing? Let us know and we'll add it if we can.
GPU | $ / FP32 TFLOPs | $ / FP16 TFLOPs | $ / Tensor Core Count | $ / Memory Capacity (GB) | $ / Memory Bandwidth (GB/s) | $ / Int8 TOPs | Minimum Price | Available for Sale |
---|---|---|---|---|---|---|---|---|
NVIDIA T4 16GB | $67.90 | $8.46 | $1.72 | $34.37 | $1.72 | $4.23 | $550 | 91 |
NVIDIA A30 24GB | $16.36 | $16.36 | $12.05 | $112.46 | $2.89 | $8.18 | $2,699 | 34 |
NVIDIA A40 48GB | $181.82 | $181.82 | $20.24 | $141.67 | $9.77 | $22.72 | $6,800 | 27 |
NVIDIA A10 24GB | $41.63 | $10.39 | $4.51 | $54.13 | $2.17 | $5.20 | $1,299 | 64 |
NVIDIA L40 48GB | $54.97 | $27.48 | $8.76 | $103.65 | $5.76 | $13.74 | $4,975 | 18 |
AMD Radeon RX 7900 XT 20GB | $12.79 | $6.46 | $3.96 | $33.25 | $0.83 | $6.46 | $665 | 71 |
NVIDIA L4 24GB | $17.32 | $8.59 | $8.66 | $86.58 | $6.93 | $4.28 | $2,078 | 33 |
NVIDIA RTX A5000 24GB | $46.78 | $46.78 | $5.07 | $54.13 | $1.69 | $2.92 | $1,299 | 75 |
NVIDIA A100 PCIe 80GB | $102.56 | $51.28 | $37.03 | $199.99 | $8.27 | $25.64 | $15,999 | 12 |
NVIDIA Tesla P100 16GB | $16.51 | $8.25 | $โ | $10.94 | $0.24 | $โ | $175 | 100 |
NVIDIA Geforce RTX 4090 24GB | $26.03 | $3.25 | $4.20 | $89.58 | $2.13 | $1.63 | $2,150 | 100 |
NVIDIA Tesla V100 32GB | $121.43 | $60.71 | $2.66 | $53.12 | $1.89 | $30.36 | $1,700 | 27 |
NVIDIA H100 PCIe 80GB | $38.35 | $19.16 | $63.59 | $362.44 | $14.22 | $9.58 | $28,995 | 12 |
AMD Radeon RX 7900 XTX 24GB | $13.52 | $6.71 | $4.30 | $34.38 | $0.86 | $6.71 | $825 | 100 |
NVIDIA L40S 48GB | $44.72 | $22.60 | $14.41 | $170.48 | $9.47 | $5.58 | $8,183 | 25 |
NVIDIA Tesla V100 16GB | $32.14 | $16.07 | $0.70 | $28.13 | $0.50 | $8.04 | $450 | 53 |
AMD Radeon RX 7700 XT 12GB | $12.86 | $6.43 | $4.17 | $37.50 | $1.04 | $โ | $450 | 39 |
AMD Radeon RX 7800 XT 16GB | $14.78 | $7.39 | $4.56 | $34.18 | $0.88 | $โ | $547 | 57 |
AMD Radeon RX 7600 XT 16GB | $14.18 | $7.09 | $5.00 | $20.00 | $1.11 | $โ | $320 | 9 |
NVIDIA GeForce RTX 5080 16GB | $10.66 | $2.67 | $3.57 | $75.00 | $1.25 | $1.33 | $1,200 | 100 |
NVIDIA GeForce RTX 5090 32GB | $14.02 | $3.50 | $4.32 | $91.78 | $1.64 | $1.75 | $2,937 | 100 |
NVIDIA GeForce RTX 5070 Ti 16GB | $7.55 | $1.89 | $2.53 | $53.13 | $0.89 | $0.94 | $850 | 99 |
NVIDIA Geforce RTX 4070 12GB | $9.11 | $2.27 | $2.88 | $44.17 | $1.05 | $1.14 | $530 | 68 |
NVIDIA Geforce RTX 4070 Ti 12GB | $8.35 | $2.09 | $2.79 | $55.83 | $1.33 | $1.04 | $670 | 45 |
NVIDIA Geforce RTX 4080 16GB | $9.52 | $2.32 | $3.05 | $57.95 | $1.29 | $1.19 | $927 | 84 |