GPUs Ranked by Cost per Int8 TOPs

Something missing? Let us know and we'll add it if we can.

GPU	$ / FP32 TFLOPs	$ / FP16 TFLOPs	$ / Tensor Core Count	$ / Memory Capacity (GB)	$ / Memory Bandwidth (GB/s)	$ / Int8 TOPs	Minimum Price	Available for Sale
NVIDIA T4 16GB	$67.90 8.1 TFLOPs	$8.46 65 TFLOPs	$1.72 320 Cores	$34.38 16 GB	$1.72 320 GB/s	$4.23 130 TOPs	$550	91
NVIDIA A30 24GB	$19.03 165 TFLOPs	$19.03 165 TFLOPs	$14.02 224 Cores	$130.83 24 GB	$3.36 933.3 GB/s	$9.52 330 TOPs	$3,140	34
NVIDIA A40 48GB	$178.90 37.4 TFLOPs	$178.90 37.4 TFLOPs	$19.91 336 Cores	$139.39 48 GB	$9.61 696 GB/s	$22.35 299.3 TOPs	$6,691	23
NVIDIA A10 24GB	$54.78 31.2 TFLOPs	$13.67 125 TFLOPs	$5.93 288 Cores	$71.21 24 GB	$2.85 600 GB/s	$6.84 250 TOPs	$1,709	62
NVIDIA L40 48GB	$63.54 90.5 TFLOPs	$31.76 181.05 TFLOPs	$10.12 568 Cores	$119.79 48 GB	$6.66 864 GB/s	$15.88 362 TOPs	$5,750	30
AMD Radeon RX 7900 XT 20GB	$13.46 52 TFLOPs	$6.80 103 TFLOPs	$4.17 168 Cores	$35.00 20 GB	$0.88 800 GB/s	$6.80 103 TOPs	$700	75
NVIDIA L4 24GB	$16.66 120 TFLOPs	$8.26 242 TFLOPs	$8.33 240 Cores	$83.32 24 GB	$6.67 300 GB/s	$4.12 485 TOPs	$2,000	35
NVIDIA RTX A5000 24GB	$56.50 27.77 TFLOPs	$56.50 27.77 TFLOPs	$6.13 256 Cores	$65.38 24 GB	$2.04 768 GB/s	$3.53 444.4 TOPs	$1,569	63
NVIDIA A100 PCIe 80GB	$104.17 156 TFLOPs	$52.08 312 TFLOPs	$37.62 432 Cores	$203.13 80 GB	$8.40 1935 GB/s	$26.04 624 TOPs	$16,250	15
NVIDIA Tesla P100 16GB	$17.45 10.6 TFLOPs	$8.73 21.2 TFLOPs	$∞ n/a	$11.56 16 GB	$0.25 732 GB/s	$∞ n/a	$185	100
NVIDIA Geforce RTX 4090 24GB	$26.63 82.6 TFLOPs	$3.33 660.6 TFLOPs	$4.30 512 Cores	$91.67 24 GB	$2.18 1008 GB/s	$1.67 1321.2 TOPs	$2,200	98
NVIDIA Tesla V100 32GB	$139.60 14 TFLOPs	$69.80 28 TFLOPs	$3.05 640 Cores	$61.07 32 GB	$2.17 900 GB/s	$34.90 56 TOPs	$1,954	36
NVIDIA H100 PCIe 80GB	$36.80 756 TFLOPs	$18.39 1513 TFLOPs	$61.01 456 Cores	$347.77 80 GB	$13.64 2039 GB/s	$9.19 3026 TOPs	$27,822	15
AMD Radeon RX 7900 XTX 24GB	$14.75 61 TFLOPs	$7.32 123 TFLOPs	$4.69 192 Cores	$37.50 24 GB	$0.94 960 GB/s	$7.32 123 TOPs	$900	80
NVIDIA L40S 48GB	$44.72 183 TFLOPs	$22.60 362 TFLOPs	$14.41 568 Cores	$170.48 48 GB	$9.47 864 GB/s	$5.58 1466 TOPs	$8,183	25
NVIDIA Tesla V100 16GB	$42.86 14 TFLOPs	$21.43 28 TFLOPs	$0.94 640 Cores	$37.50 16 GB	$0.67 900 GB/s	$10.71 56 TOPs	$600	45
AMD Radeon RX 7700 XT 12GB	$14.29 35 TFLOPs	$7.14 70 TFLOPs	$4.63 108 Cores	$41.67 12 GB	$1.16 432 GB/s	$∞ n/a	$500	41
AMD Radeon RX 7800 XT 16GB	$18.38 37 TFLOPs	$9.19 74 TFLOPs	$5.67 120 Cores	$42.49 16 GB	$1.09 624 GB/s	$∞ n/a	$680	53
AMD Radeon RX 7600 XT 16GB	$20.10 22.57 TFLOPs	$10.05 45.14 TFLOPs	$7.09 64 Cores	$28.35 16 GB	$1.58 288 GB/s	$∞ n/a	$454	7
NVIDIA GeForce RTX 5080 16GB	$12.43 112.6 TFLOPs	$3.11 450.2 TFLOPs	$4.17 336 Cores	$87.50 16 GB	$1.46 960 GB/s	$1.55 900.4 TOPs	$1,400	97
NVIDIA GeForce RTX 5090 32GB	$16.23 209.5 TFLOPs	$4.06 838 TFLOPs	$5.00 680 Cores	$106.25 32 GB	$1.90 1792 GB/s	$2.03 1676 TOPs	$3,400	65
NVIDIA GeForce RTX 5070 Ti 16GB	$9.24 112.6 TFLOPs	$2.31 450.2 TFLOPs	$3.10 336 Cores	$65.00 16 GB	$1.08 960 GB/s	$1.16 900.4 TOPs	$1,040	82
NVIDIA Geforce RTX 4070 12GB	$9.62 58.2 TFLOPs	$2.40 233.2 TFLOPs	$3.04 184 Cores	$46.66 12 GB	$1.11 504 GB/s	$1.20 466.4 TOPs	$560	65
NVIDIA Geforce RTX 4070 Ti 12GB	$8.73 80.2 TFLOPs	$2.18 320.8 TFLOPs	$2.92 240 Cores	$58.33 12 GB	$1.39 504 GB/s	$1.09 641.4 TOPs	$700	41
NVIDIA Geforce RTX 4080 16GB	$9.55 97.4 TFLOPs	$2.33 398.8 TFLOPs	$3.06 304 Cores	$58.12 16 GB	$1.30 716.8 GB/s	$1.19 779.82 TOPs	$930	74