GPUs Ranked by Cost per Tensor Core Count

Something missing? Let us know and we'll add it if we can.

GPU	$ / FP32 TFLOPs	$ / FP16 TFLOPs	$ / Tensor Core Count	$ / Memory Capacity (GB)	$ / Memory Bandwidth (GB/s)	$ / Int8 TOPs	Minimum Price	Available for Sale
AMD Radeon RX 7600 XT 16GB	$12.36 22.57 TFLOPs	$6.18 45.14 TFLOPs	$4.36 64 Cores	$17.44 16 GB	$0.97 288 GB/s	$∞ n/a	$279	15
AMD Radeon RX 7700 XT 12GB	$9.43 35 TFLOPs	$4.71 70 TFLOPs	$3.06 108 Cores	$27.50 12 GB	$0.76 432 GB/s	$∞ n/a	$330	56
AMD Radeon RX 7800 XT 16GB	$11.32 37 TFLOPs	$5.66 74 TFLOPs	$3.49 120 Cores	$26.19 16 GB	$0.67 624 GB/s	$∞ n/a	$419	67
AMD Radeon RX 7900 XT 20GB	$9.59 52 TFLOPs	$4.84 103 TFLOPs	$2.97 168 Cores	$24.94 20 GB	$0.62 800 GB/s	$4.84 103 TOPs	$499	97
AMD Radeon RX 7900 XTX 24GB	$1.89 61 TFLOPs	$0.93 123 TFLOPs	$0.60 192 Cores	$4.79 24 GB	$0.12 960 GB/s	$0.93 123 TOPs	$115	100
NVIDIA A10 24GB	$39.10 31.2 TFLOPs	$9.76 125 TFLOPs	$4.24 288 Cores	$50.83 24 GB	$2.03 600 GB/s	$4.88 250 TOPs	$1,220	73
NVIDIA A100 PCIe 80GB	$59.29 156 TFLOPs	$29.65 312 TFLOPs	$21.41 432 Cores	$115.63 80 GB	$4.78 1935 GB/s	$14.82 624 TOPs	$9,250	17
NVIDIA A30 24GB	$17.88 165 TFLOPs	$17.88 165 TFLOPs	$13.17 224 Cores	$122.92 24 GB	$3.16 933.3 GB/s	$8.94 330 TOPs	$2,950	51
NVIDIA A40 48GB	$114.67 37.4 TFLOPs	$114.67 37.4 TFLOPs	$12.76 336 Cores	$89.35 48 GB	$6.16 696 GB/s	$14.33 299.3 TOPs	$4,289	35
NVIDIA Geforce RTX 4070 Ti 12GB	$7.09 80.2 TFLOPs	$1.77 320.8 TFLOPs	$2.37 240 Cores	$47.42 12 GB	$1.13 504 GB/s	$0.89 641.4 TOPs	$569	48
NVIDIA Geforce RTX 4070 12GB	$7.01 58.2 TFLOPs	$1.75 233.2 TFLOPs	$2.22 184 Cores	$34.00 12 GB	$0.81 504 GB/s	$0.87 466.4 TOPs	$408	79
NVIDIA Geforce RTX 4080 16GB	$7.80 97.4 TFLOPs	$1.91 398.8 TFLOPs	$2.50 304 Cores	$47.50 16 GB	$1.06 716.8 GB/s	$0.97 779.82 TOPs	$760	98
NVIDIA Geforce RTX 4090 24GB	$25.42 82.6 TFLOPs	$3.18 660.6 TFLOPs	$4.10 512 Cores	$87.50 24 GB	$2.08 1008 GB/s	$1.59 1321.2 TOPs	$2,100	98
NVIDIA GeForce RTX 5070 Ti 16GB	$6.42 112.6 TFLOPs	$1.60 450.2 TFLOPs	$2.15 336 Cores	$45.15 16 GB	$0.75 960 GB/s	$0.80 900.4 TOPs	$722	98
NVIDIA GeForce RTX 5080 16GB	$9.06 112.6 TFLOPs	$2.27 450.2 TFLOPs	$3.04 336 Cores	$63.74 16 GB	$1.06 960 GB/s	$1.13 900.4 TOPs	$1,020	97
NVIDIA H100 PCIe 80GB	$36.34 756 TFLOPs	$18.16 1513 TFLOPs	$60.25 456 Cores	$343.42 80 GB	$13.47 2039 GB/s	$9.08 3026 TOPs	$27,474	12
NVIDIA L4 24GB	$16.63 120 TFLOPs	$8.25 242 TFLOPs	$8.32 240 Cores	$83.17 24 GB	$6.65 300 GB/s	$4.12 485 TOPs	$1,996	50
NVIDIA L40 48GB	$77.34 90.5 TFLOPs	$38.66 181.05 TFLOPs	$12.32 568 Cores	$145.81 48 GB	$8.10 864 GB/s	$19.33 362 TOPs	$6,999	23
NVIDIA L40S 48GB	$40.98 183 TFLOPs	$20.72 362 TFLOPs	$13.20 568 Cores	$156.25 48 GB	$8.68 864 GB/s	$5.12 1466 TOPs	$7,500	38
NVIDIA RTX A5000 24GB	$52.21 27.77 TFLOPs	$52.21 27.77 TFLOPs	$5.66 256 Cores	$60.42 24 GB	$1.89 768 GB/s	$3.26 444.4 TOPs	$1,450	73
NVIDIA T4 16GB	$9.88 8.1 TFLOPs	$1.23 65 TFLOPs	$0.25 320 Cores	$5.00 16 GB	$0.25 320 GB/s	$0.62 130 TOPs	$80	96
NVIDIA Tesla P100 16GB	$8.96 10.6 TFLOPs	$4.48 21.2 TFLOPs	$∞ n/a	$5.94 16 GB	$0.13 732 GB/s	$∞ n/a	$95	98
NVIDIA Tesla V100 16GB	$20.00 14 TFLOPs	$10.00 28 TFLOPs	$0.44 640 Cores	$17.50 16 GB	$0.31 900 GB/s	$5.00 56 TOPs	$280	72
NVIDIA Tesla V100 32GB	$50.00 14 TFLOPs	$25.00 28 TFLOPs	$1.09 640 Cores	$21.87 32 GB	$0.78 900 GB/s	$12.50 56 TOPs	$700	62
NVIDIA GeForce RTX 5090 32GB	$11.93 209.5 TFLOPs	$2.98 838 TFLOPs	$3.68 680 Cores	$78.09 32 GB	$1.39 1792 GB/s	$1.49 1676 TOPs	$2,499	98