GPUs Ranked by Cost per Int8 TOPs
Something missing? Let us know and we'll add it if we can.
| GPU | $ / FP32 TFLOPs | $ / FP16 TFLOPs | $ / Tensor Core Count | $ / Memory Capacity (GB) | $ / Memory Bandwidth (GB/s) | $ / Int8 TOPs | Minimum Price | Available for Sale |
|---|---|---|---|---|---|---|---|---|
| AMD Radeon RX 7600 XT 16GB | $12.18 | $6.09 | $4.30 | $17.19 | $0.95 | $∞ | $275 | 12 |
| AMD Radeon RX 7700 XT 12GB | $9.86 | $4.93 | $3.19 | $28.75 | $0.80 | $∞ | $345 | 43 |
| AMD Radeon RX 7800 XT 16GB | $10.68 | $5.34 | $3.29 | $24.69 | $0.63 | $∞ | $395 | 56 |
| AMD Radeon RX 7900 XT 20GB | $9.62 | $4.85 | $2.98 | $25.00 | $0.63 | $4.85 | $500 | 87 |
| AMD Radeon RX 7900 XTX 24GB | $10.97 | $5.44 | $3.48 | $27.88 | $0.70 | $5.44 | $669 | 96 |
| NVIDIA A10 24GB | $41.67 | $10.40 | $4.51 | $54.17 | $2.17 | $5.20 | $1,300 | 70 |
| NVIDIA A100 PCIe 80GB | $58.65 | $29.33 | $21.18 | $114.38 | $4.73 | $14.66 | $9,150 | 18 |
| NVIDIA A30 24GB | $12.73 | $12.73 | $9.37 | $87.50 | $2.25 | $6.36 | $2,100 | 46 |
| NVIDIA A40 48GB | $125.67 | $125.67 | $13.99 | $97.92 | $6.75 | $15.70 | $4,700 | 33 |
| NVIDIA Geforce RTX 4070 Ti 12GB | $6.23 | $1.56 | $2.08 | $41.66 | $0.99 | $0.78 | $500 | 43 |
| NVIDIA Geforce RTX 4070 12GB | $7.22 | $1.80 | $2.28 | $35.00 | $0.83 | $0.90 | $420 | 74 |
| NVIDIA Geforce RTX 4080 16GB | $7.32 | $1.79 | $2.35 | $44.57 | $0.99 | $0.91 | $713 | 102 |
| NVIDIA Geforce RTX 4090 24GB | $28.45 | $3.56 | $4.59 | $97.92 | $2.33 | $1.78 | $2,350 | 100 |
| NVIDIA GeForce RTX 5070 Ti 16GB | $6.66 | $1.67 | $2.23 | $46.88 | $0.78 | $0.83 | $750 | 100 |
| NVIDIA GeForce RTX 5080 16GB | $8.57 | $2.14 | $2.87 | $60.31 | $1.01 | $1.07 | $965 | 100 |
| NVIDIA H100 PCIe 80GB | $36.05 | $18.02 | $59.78 | $340.72 | $13.37 | $9.01 | $27,257 | 12 |
| NVIDIA L4 24GB | $18.23 | $9.04 | $9.12 | $91.17 | $7.29 | $4.51 | $2,188 | 51 |
| NVIDIA L40 48GB | $71.82 | $35.90 | $11.44 | $135.42 | $7.52 | $17.96 | $6,500 | 46 |
| NVIDIA L40S 48GB | $38.25 | $19.34 | $12.32 | $145.83 | $8.10 | $4.77 | $7,000 | 19 |
| NVIDIA RTX A5000 24GB | $53.11 | $53.11 | $5.76 | $61.46 | $1.92 | $3.32 | $1,475 | 69 |
| NVIDIA T4 16GB | $9.88 | $1.23 | $0.25 | $5.00 | $0.25 | $0.62 | $80 | 83 |
| NVIDIA Tesla P100 16GB | $7.55 | $3.77 | $∞ | $5.00 | $0.11 | $∞ | $80 | 100 |
| NVIDIA Tesla V100 16GB | $12.50 | $6.25 | $0.27 | $10.94 | $0.19 | $3.13 | $175 | 69 |
| NVIDIA Tesla V100 32GB | $50.00 | $25.00 | $1.09 | $21.87 | $0.78 | $12.50 | $700 | 61 |
| NVIDIA GeForce RTX 5090 32GB | $12.41 | $3.10 | $3.82 | $81.22 | $1.45 | $1.55 | $2,599 | 94 |
| AMD Radeon RX 7900 GRE 16GB | $8.81 | $4.40 | $2.53 | $25.31 | $0.70 | $2.20 | $405 | 19 |
| AMD Radeon RX 9060 XT 16GB | $14.26 | $7.11 | $5.70 | $22.81 | $1.14 | $∞ | $365 | 65 |
| AMD Radeon RX 9070 XT 16GB | $13.35 | $6.67 | $5.08 | $40.63 | $1.02 | $∞ | $650 | 56 |
| AMD Radeon RX 9070 16GB | $14.93 | $7.47 | $4.81 | $33.69 | $0.84 | $∞ | $539 | 74 |
| NVIDIA GeForce RTX 3080 Ti 12GB | $11.00 | $2.75 | $1.17 | $31.25 | $0.41 | $0.69 | $375 | 75 |
| NVIDIA GeForce RTX 3080 10GB | $9.54 | $2.39 | $1.04 | $28.40 | $0.37 | $0.60 | $284 | 97 |
| NVIDIA GeForce RTX 4070 SUPER 12GB | $16.91 | $4.23 | $2.68 | $50.00 | $1.19 | $1.06 | $600 | 9 |
| NVIDIA GeForce RTX 4080 SUPER 16GB | $18.19 | $4.54 | $5.94 | $118.75 | $2.58 | $2.27 | $1,900 | 1 |
| NVIDIA GeForce RTX 5060 Ti 16GB | $18.56 | $4.64 | $3.06 | $27.50 | $0.98 | $1.16 | $440 | 90 |