GPUs Ranked by Cost per Int8 TOPs
Something missing? Let us know and we'll add it if we can.
GPU | $ / FP32 TFLOPs | $ / FP16 TFLOPs | $ / Tensor Core Count | $ / Memory Capacity (GB) | $ / Memory Bandwidth (GB/s) | $ / Int8 TOPs | Minimum Price | Available for Sale |
---|---|---|---|---|---|---|---|---|
NVIDIA T4 16GB | $71.60 | $8.92 | $1.81 | $36.25 | $1.81 | $4.46 | $580 | 85 |
NVIDIA A30 24GB | $17.88 | $17.88 | $13.17 | $122.92 | $3.16 | $8.94 | $2,950 | 46 |
NVIDIA A40 48GB | $114.97 | $114.97 | $12.80 | $89.58 | $6.18 | $14.37 | $4,300 | 37 |
NVIDIA A10 24GB | $35.26 | $8.80 | $3.82 | $45.83 | $1.83 | $4.40 | $1,100 | 71 |
NVIDIA L40 48GB | $55.19 | $27.59 | $8.79 | $104.06 | $5.78 | $13.80 | $4,995 | 27 |
AMD Radeon RX 7900 XT 20GB | $10.58 | $5.34 | $3.27 | $27.50 | $0.69 | $5.34 | $550 | 90 |
NVIDIA L4 24GB | $14.83 | $7.36 | $7.42 | $74.17 | $5.93 | $3.67 | $1,780 | 53 |
NVIDIA RTX A5000 24GB | $46.78 | $46.78 | $5.07 | $54.13 | $1.69 | $2.92 | $1,299 | 69 |
NVIDIA A100 PCIe 80GB | $62.18 | $31.09 | $22.45 | $121.25 | $5.01 | $15.54 | $9,700 | 12 |
NVIDIA Tesla P100 16GB | $9.24 | $4.62 | $โ | $6.12 | $0.13 | $โ | $98 | 100 |
NVIDIA Geforce RTX 4090 24GB | $0.96 | $0.12 | $0.15 | $3.29 | $0.08 | $0.06 | $79 | 100 |
NVIDIA Tesla V100 32GB | $50.00 | $25.00 | $1.09 | $21.87 | $0.78 | $12.50 | $700 | 61 |
NVIDIA H100 PCIe 80GB | $36.45 | $18.21 | $60.42 | $344.41 | $13.51 | $9.11 | $27,553 | 12 |
AMD Radeon RX 7900 XTX 24GB | $10.58 | $5.25 | $3.36 | $26.88 | $0.67 | $5.25 | $645 | 100 |
NVIDIA L40S 48GB | $38.25 | $19.34 | $12.32 | $145.83 | $8.10 | $4.77 | $7,000 | 34 |
NVIDIA Tesla V100 16GB | $20.00 | $10.00 | $0.44 | $17.50 | $0.31 | $5.00 | $280 | 67 |
AMD Radeon RX 7700 XT 12GB | $8.57 | $4.29 | $2.78 | $25.00 | $0.69 | $โ | $300 | 52 |
AMD Radeon RX 7800 XT 16GB | $10.92 | $5.46 | $3.37 | $25.25 | $0.65 | $โ | $404 | 69 |
AMD Radeon RX 7600 XT 16GB | $13.29 | $6.65 | $4.69 | $18.75 | $1.04 | $โ | $300 | 17 |
NVIDIA GeForce RTX 5080 16GB | $9.10 | $2.28 | $3.05 | $64.06 | $1.07 | $1.14 | $1,025 | 100 |
NVIDIA GeForce RTX 5090 32GB | $11.59 | $2.90 | $3.57 | $75.91 | $1.36 | $1.45 | $2,429 | 98 |
NVIDIA GeForce RTX 5070 Ti 16GB | $6.84 | $1.71 | $2.29 | $48.12 | $0.80 | $0.86 | $770 | 100 |
NVIDIA Geforce RTX 4070 12GB | $7.39 | $1.84 | $2.34 | $35.83 | $0.85 | $0.92 | $430 | 68 |
NVIDIA Geforce RTX 4070 Ti 12GB | $4.99 | $1.25 | $1.67 | $33.33 | $0.79 | $0.62 | $400 | 63 |
NVIDIA Geforce RTX 4080 16GB | $7.80 | $1.91 | $2.50 | $47.50 | $1.06 | $0.97 | $760 | 99 |