GPUs Ranked by Cost per Int8 TOPs

Something missing? Let us know and we'll add it if we can.

GPU	$ / FP32 TFLOPs	$ / FP16 TFLOPs	$ / Tensor Core Count	$ / Memory Capacity (GB)	$ / Memory Bandwidth (GB/s)	$ / Int8 TOPs	Minimum Price	Available for Sale
NVIDIA T4 16GB	$61.73 8.1 TFLOPs	$7.69 65 TFLOPs	$1.56 320 Cores	$31.25 16 GB	$1.56 320 GB/s	$3.85 130 TOPs	$500	95
NVIDIA A30 24GB	$16.67 165 TFLOPs	$16.67 165 TFLOPs	$12.28 224 Cores	$114.58 24 GB	$2.95 933.3 GB/s	$8.33 330 TOPs	$2,750	37
NVIDIA A40 48GB	$155.89 37.4 TFLOPs	$155.89 37.4 TFLOPs	$17.35 336 Cores	$121.47 48 GB	$8.38 696 GB/s	$19.48 299.3 TOPs	$5,830	20
NVIDIA A10 24GB	$54.78 31.2 TFLOPs	$13.67 125 TFLOPs	$5.93 288 Cores	$71.21 24 GB	$2.85 600 GB/s	$6.84 250 TOPs	$1,709	66
NVIDIA L40 48GB	$55.19 90.5 TFLOPs	$27.59 181.05 TFLOPs	$8.79 568 Cores	$104.06 48 GB	$5.78 864 GB/s	$13.80 362 TOPs	$4,995	61
AMD Radeon RX 7900 XT 20GB	$14.04 52 TFLOPs	$7.09 103 TFLOPs	$4.35 168 Cores	$36.50 20 GB	$0.91 800 GB/s	$7.09 103 TOPs	$730	65
NVIDIA L4 24GB	$16.25 120 TFLOPs	$8.06 242 TFLOPs	$8.13 240 Cores	$81.25 24 GB	$6.50 300 GB/s	$4.02 485 TOPs	$1,950	37
NVIDIA RTX A5000 24GB	$54.73 27.77 TFLOPs	$54.73 27.77 TFLOPs	$5.94 256 Cores	$63.33 24 GB	$1.98 768 GB/s	$3.42 444.4 TOPs	$1,520	64
NVIDIA A100 PCIe 80GB	$115.38 156 TFLOPs	$57.69 312 TFLOPs	$41.66 432 Cores	$224.99 80 GB	$9.30 1935 GB/s	$28.84 624 TOPs	$17,999	11
NVIDIA Tesla P100 16GB	$18.86 10.6 TFLOPs	$9.43 21.2 TFLOPs	$∞ n/a	$12.50 16 GB	$0.27 732 GB/s	$∞ n/a	$200	100
NVIDIA Geforce RTX 4090 24GB	$27.93 82.6 TFLOPs	$3.49 660.6 TFLOPs	$4.51 512 Cores	$96.13 24 GB	$2.29 1008 GB/s	$1.75 1321.2 TOPs	$2,307	98
NVIDIA Tesla V100 32GB	$142.79 14 TFLOPs	$71.39 28 TFLOPs	$3.12 640 Cores	$62.47 32 GB	$2.22 900 GB/s	$35.70 56 TOPs	$1,999	33
NVIDIA H100 PCIe 80GB	$35.55 756 TFLOPs	$17.76 1513 TFLOPs	$58.93 456 Cores	$335.91 80 GB	$13.18 2039 GB/s	$8.88 3026 TOPs	$26,873	13
AMD Radeon RX 7900 XTX 24GB	$15.57 61 TFLOPs	$7.72 123 TFLOPs	$4.95 192 Cores	$39.58 24 GB	$0.99 960 GB/s	$7.72 123 TOPs	$950	86
NVIDIA L40S 48GB	$61.20 183 TFLOPs	$30.94 362 TFLOPs	$19.72 568 Cores	$233.31 48 GB	$12.96 864 GB/s	$7.64 1466 TOPs	$11,199	1
NVIDIA Tesla V100 16GB	$39.29 14 TFLOPs	$19.64 28 TFLOPs	$0.86 640 Cores	$34.38 16 GB	$0.61 900 GB/s	$9.82 56 TOPs	$550	51
AMD Radeon RX 7700 XT 12GB	$12.00 35 TFLOPs	$6.00 70 TFLOPs	$3.89 108 Cores	$35.00 12 GB	$0.97 432 GB/s	$∞ n/a	$420	43
AMD Radeon RX 7800 XT 16GB	$16.08 37 TFLOPs	$8.04 74 TFLOPs	$4.96 120 Cores	$37.19 16 GB	$0.95 624 GB/s	$∞ n/a	$595	64
AMD Radeon RX 7600 XT 16GB	$20.10 22.57 TFLOPs	$10.05 45.14 TFLOPs	$7.09 64 Cores	$28.35 16 GB	$1.58 288 GB/s	$∞ n/a	$454	11
NVIDIA GeForce RTX 5080 16GB	$12.43 112.6 TFLOPs	$3.11 450.2 TFLOPs	$4.17 336 Cores	$87.50 16 GB	$1.46 960 GB/s	$1.55 900.4 TOPs	$1,400	97
NVIDIA GeForce RTX 5090 32GB	$16.61 209.5 TFLOPs	$4.15 838 TFLOPs	$5.12 680 Cores	$108.75 32 GB	$1.94 1792 GB/s	$2.08 1676 TOPs	$3,480	49
NVIDIA GeForce RTX 5070 Ti 16GB	$8.87 112.6 TFLOPs	$2.22 450.2 TFLOPs	$2.97 336 Cores	$62.44 16 GB	$1.04 960 GB/s	$1.11 900.4 TOPs	$999	78
NVIDIA Geforce RTX 4070 12GB	$8.57 58.2 TFLOPs	$2.14 233.2 TFLOPs	$2.71 184 Cores	$41.54 12 GB	$0.99 504 GB/s	$1.07 466.4 TOPs	$499	51
NVIDIA Geforce RTX 4070 Ti 12GB	$8.98 80.2 TFLOPs	$2.24 320.8 TFLOPs	$3.00 240 Cores	$60.00 12 GB	$1.43 504 GB/s	$1.12 641.4 TOPs	$720	40
NVIDIA Geforce RTX 4080 16GB	$11.09 97.4 TFLOPs	$2.71 398.8 TFLOPs	$3.55 304 Cores	$67.50 16 GB	$1.51 716.8 GB/s	$1.38 779.82 TOPs	$1,080	76