GPUs Ranked by Cost per Int8 TOPs

Something missing? Let us know and we'll add it if we can.

GPU	$ / FP32 TFLOPs	$ / FP16 TFLOPs	$ / Tensor Core Count	$ / Memory Capacity (GB)	$ / Memory Bandwidth (GB/s)	$ / Int8 TOPs	Minimum Price	Available for Sale
NVIDIA T4 16GB	$74.07 8.1 TFLOPs	$9.23 65 TFLOPs	$1.87 320 Cores	$37.50 16 GB	$1.87 320 GB/s	$4.62 130 TOPs	$600	93
NVIDIA A30 24GB	$17.33 165 TFLOPs	$17.33 165 TFLOPs	$12.77 224 Cores	$119.17 24 GB	$3.06 933.3 GB/s	$8.67 330 TOPs	$2,860	36
NVIDIA A40 48GB	$176.59 37.4 TFLOPs	$176.59 37.4 TFLOPs	$19.66 336 Cores	$137.59 48 GB	$9.49 696 GB/s	$22.07 299.3 TOPs	$6,604	26
NVIDIA A10 24GB	$48.08 31.2 TFLOPs	$12.00 125 TFLOPs	$5.21 288 Cores	$62.50 24 GB	$2.50 600 GB/s	$6.00 250 TOPs	$1,500	61
NVIDIA L40 48GB	$50.94 90.5 TFLOPs	$25.46 181.05 TFLOPs	$8.12 568 Cores	$96.04 48 GB	$5.34 864 GB/s	$12.73 362 TOPs	$4,610	27
AMD Radeon RX 7900 XT 20GB	$12.98 52 TFLOPs	$6.55 103 TFLOPs	$4.02 168 Cores	$33.75 20 GB	$0.84 800 GB/s	$6.55 103 TOPs	$675	71
NVIDIA L4 24GB	$17.33 120 TFLOPs	$8.59 242 TFLOPs	$8.66 240 Cores	$86.63 24 GB	$6.93 300 GB/s	$4.29 485 TOPs	$2,079	29
NVIDIA RTX A5000 24GB	$55.46 27.77 TFLOPs	$55.46 27.77 TFLOPs	$6.02 256 Cores	$64.17 24 GB	$2.01 768 GB/s	$3.47 444.4 TOPs	$1,540	64
NVIDIA A100 PCIe 80GB	$104.17 156 TFLOPs	$52.08 312 TFLOPs	$37.62 432 Cores	$203.13 80 GB	$8.40 1935 GB/s	$26.04 624 TOPs	$16,250	11
NVIDIA Tesla P100 16GB	$18.40 10.6 TFLOPs	$9.20 21.2 TFLOPs	$∞ n/a	$12.19 16 GB	$0.27 732 GB/s	$∞ n/a	$195	98
NVIDIA Geforce RTX 4090 24GB	$27.83 82.6 TFLOPs	$3.48 660.6 TFLOPs	$4.49 512 Cores	$95.79 24 GB	$2.28 1008 GB/s	$1.74 1321.2 TOPs	$2,299	91
NVIDIA Tesla V100 32GB	$111.05 14 TFLOPs	$55.53 28 TFLOPs	$2.43 640 Cores	$48.59 32 GB	$1.73 900 GB/s	$27.76 56 TOPs	$1,555	33
NVIDIA H100 PCIe 80GB	$38.35 756 TFLOPs	$19.16 1513 TFLOPs	$63.59 456 Cores	$362.44 80 GB	$14.22 2039 GB/s	$9.58 3026 TOPs	$28,995	12
AMD Radeon RX 7900 XTX 24GB	$13.69 61 TFLOPs	$6.79 123 TFLOPs	$4.35 192 Cores	$34.79 24 GB	$0.87 960 GB/s	$6.79 123 TOPs	$835	94
NVIDIA L40S 48GB	$44.72 183 TFLOPs	$22.60 362 TFLOPs	$14.41 568 Cores	$170.48 48 GB	$9.47 864 GB/s	$5.58 1466 TOPs	$8,183	25
NVIDIA Tesla V100 16GB	$45.00 14 TFLOPs	$22.50 28 TFLOPs	$0.98 640 Cores	$39.37 16 GB	$0.70 900 GB/s	$11.25 56 TOPs	$630	45
AMD Radeon RX 7700 XT 12GB	$13.28 35 TFLOPs	$6.64 70 TFLOPs	$4.31 108 Cores	$38.75 12 GB	$1.08 432 GB/s	$∞ n/a	$465	36
AMD Radeon RX 7800 XT 16GB	$15.13 37 TFLOPs	$7.57 74 TFLOPs	$4.67 120 Cores	$35.00 16 GB	$0.90 624 GB/s	$∞ n/a	$560	56
AMD Radeon RX 7600 XT 16GB	$15.51 22.57 TFLOPs	$7.75 45.14 TFLOPs	$5.47 64 Cores	$21.87 16 GB	$1.22 288 GB/s	$∞ n/a	$350	5
NVIDIA GeForce RTX 5080 16GB	$11.54 112.6 TFLOPs	$2.89 450.2 TFLOPs	$3.87 336 Cores	$81.25 16 GB	$1.35 960 GB/s	$1.44 900.4 TOPs	$1,300	99
NVIDIA GeForce RTX 5090 32GB	$15.03 209.5 TFLOPs	$3.76 838 TFLOPs	$4.63 680 Cores	$98.38 32 GB	$1.76 1792 GB/s	$1.88 1676 TOPs	$3,148	74
NVIDIA GeForce RTX 5070 Ti 16GB	$8.79 112.6 TFLOPs	$2.20 450.2 TFLOPs	$2.95 336 Cores	$61.87 16 GB	$1.03 960 GB/s	$1.10 900.4 TOPs	$990	82
NVIDIA Geforce RTX 4070 12GB	$9.04 58.2 TFLOPs	$2.26 233.2 TFLOPs	$2.86 184 Cores	$43.83 12 GB	$1.04 504 GB/s	$1.13 466.4 TOPs	$526	66
NVIDIA Geforce RTX 4070 Ti 12GB	$8.98 80.2 TFLOPs	$2.24 320.8 TFLOPs	$3.00 240 Cores	$60.00 12 GB	$1.43 504 GB/s	$1.12 641.4 TOPs	$720	46
NVIDIA Geforce RTX 4080 16GB	$9.88 97.4 TFLOPs	$2.41 398.8 TFLOPs	$3.16 304 Cores	$60.13 16 GB	$1.34 716.8 GB/s	$1.23 779.82 TOPs	$962	77