GPUs Ranked by Cost per Int8 TOPs

Something missing? Let us know and we'll add it if we can.

GPU	$ / FP32 TFLOPs	$ / FP16 TFLOPs	$ / Tensor Core Count	$ / Memory Capacity (GB)	$ / Memory Bandwidth (GB/s)	$ / Int8 TOPs	Minimum Price	Available for Sale
NVIDIA T4 16GB	$67.90 8.1 TFLOPs	$8.46 65 TFLOPs	$1.72 320 Cores	$34.38 16 GB	$1.72 320 GB/s	$4.23 130 TOPs	$550	86
NVIDIA A30 24GB	$13.94 165 TFLOPs	$13.94 165 TFLOPs	$10.27 224 Cores	$95.83 24 GB	$2.46 933.3 GB/s	$6.97 330 TOPs	$2,300	44
NVIDIA A40 48GB	$140.37 37.4 TFLOPs	$140.37 37.4 TFLOPs	$15.63 336 Cores	$109.38 48 GB	$7.54 696 GB/s	$17.54 299.3 TOPs	$5,250	29
NVIDIA A10 24GB	$44.84 31.2 TFLOPs	$11.19 125 TFLOPs	$4.86 288 Cores	$58.29 24 GB	$2.33 600 GB/s	$5.60 250 TOPs	$1,399	68
NVIDIA L40 48GB	$55.24 90.5 TFLOPs	$27.61 181.05 TFLOPs	$8.80 568 Cores	$104.15 48 GB	$5.79 864 GB/s	$13.81 362 TOPs	$4,999	28
AMD Radeon RX 7900 XT 20GB	$11.44 52 TFLOPs	$5.78 103 TFLOPs	$3.54 168 Cores	$29.75 20 GB	$0.74 800 GB/s	$5.78 103 TOPs	$595	91
NVIDIA L4 24GB	$15.63 120 TFLOPs	$7.75 242 TFLOPs	$7.81 240 Cores	$78.13 24 GB	$6.25 300 GB/s	$3.87 485 TOPs	$1,875	55
NVIDIA RTX A5000 24GB	$46.74 27.77 TFLOPs	$46.74 27.77 TFLOPs	$5.07 256 Cores	$54.08 24 GB	$1.69 768 GB/s	$2.92 444.4 TOPs	$1,298	85
NVIDIA A100 PCIe 80GB	$67.29 156 TFLOPs	$33.65 312 TFLOPs	$24.30 432 Cores	$131.23 80 GB	$5.43 1935 GB/s	$16.82 624 TOPs	$10,498	11
NVIDIA Tesla P100 16GB	$10.85 10.6 TFLOPs	$5.42 21.2 TFLOPs	$∞ n/a	$7.19 16 GB	$0.16 732 GB/s	$∞ n/a	$115	100
NVIDIA Geforce RTX 4090 24GB	$26.63 82.6 TFLOPs	$3.33 660.6 TFLOPs	$4.30 512 Cores	$91.67 24 GB	$2.18 1008 GB/s	$1.67 1321.2 TOPs	$2,200	99
NVIDIA Tesla V100 32GB	$76.86 14 TFLOPs	$38.43 28 TFLOPs	$1.68 640 Cores	$33.63 32 GB	$1.20 900 GB/s	$19.22 56 TOPs	$1,076	51
NVIDIA H100 PCIe 80GB	$36.55 756 TFLOPs	$18.26 1513 TFLOPs	$60.59 456 Cores	$345.37 80 GB	$13.55 2039 GB/s	$9.13 3026 TOPs	$27,630	10
AMD Radeon RX 7900 XTX 24GB	$12.46 61 TFLOPs	$6.18 123 TFLOPs	$3.96 192 Cores	$31.67 24 GB	$0.79 960 GB/s	$6.18 123 TOPs	$760	99
NVIDIA L40S 48GB	$41.12 183 TFLOPs	$20.79 362 TFLOPs	$13.25 568 Cores	$156.77 48 GB	$8.71 864 GB/s	$5.13 1466 TOPs	$7,525	30
NVIDIA Tesla V100 16GB	$26.70 14 TFLOPs	$13.35 28 TFLOPs	$0.58 640 Cores	$23.36 16 GB	$0.42 900 GB/s	$6.68 56 TOPs	$374	60
AMD Radeon RX 7700 XT 12GB	$9.29 35 TFLOPs	$4.64 70 TFLOPs	$3.01 108 Cores	$27.08 12 GB	$0.75 432 GB/s	$∞ n/a	$325	66
AMD Radeon RX 7800 XT 16GB	$13.19 37 TFLOPs	$6.59 74 TFLOPs	$4.07 120 Cores	$30.50 16 GB	$0.78 624 GB/s	$∞ n/a	$488	79
AMD Radeon RX 7600 XT 16GB	$13.29 22.57 TFLOPs	$6.65 45.14 TFLOPs	$4.69 64 Cores	$18.75 16 GB	$1.04 288 GB/s	$∞ n/a	$300	21
NVIDIA GeForce RTX 5080 16GB	$8.87 112.6 TFLOPs	$2.22 450.2 TFLOPs	$2.97 336 Cores	$62.44 16 GB	$1.04 960 GB/s	$1.11 900.4 TOPs	$999	100
NVIDIA GeForce RTX 5090 32GB	$11.45 209.5 TFLOPs	$2.86 838 TFLOPs	$3.53 680 Cores	$74.97 32 GB	$1.34 1792 GB/s	$1.43 1676 TOPs	$2,399	100
NVIDIA GeForce RTX 5070 Ti 16GB	$7.02 112.6 TFLOPs	$1.75 450.2 TFLOPs	$2.35 336 Cores	$49.37 16 GB	$0.82 960 GB/s	$0.88 900.4 TOPs	$790	99
NVIDIA Geforce RTX 4070 12GB	$7.39 58.2 TFLOPs	$1.84 233.2 TFLOPs	$2.34 184 Cores	$35.83 12 GB	$0.85 504 GB/s	$0.92 466.4 TOPs	$430	100
NVIDIA Geforce RTX 4070 Ti 12GB	$7.22 80.2 TFLOPs	$1.80 320.8 TFLOPs	$2.41 240 Cores	$48.25 12 GB	$1.15 504 GB/s	$0.90 641.4 TOPs	$579	30
NVIDIA Geforce RTX 4080 16GB	$8.73 97.4 TFLOPs	$2.13 398.8 TFLOPs	$2.80 304 Cores	$53.13 16 GB	$1.19 716.8 GB/s	$1.09 779.82 TOPs	$850	98