GPUs Ranked by Cost per Tensor Core Count

Something missing? Let us know and we'll add it if we can.

GPU	$ / FP32 TFLOPs	$ / FP16 TFLOPs	$ / Tensor Core Count	$ / Memory Capacity (GB)	$ / Memory Bandwidth (GB/s)	$ / Int8 TOPs	Minimum Price	Available for Sale
NVIDIA T4 16GB	$3.24 8.1 TFLOPs	$0.40 65 TFLOPs	$0.08 320 Cores	$1.64 16 GB	$0.08 320 GB/s	$0.20 130 TOPs	$26	85
NVIDIA A30 24GB	$21.27 165 TFLOPs	$21.27 165 TFLOPs	$15.67 224 Cores	$146.25 24 GB	$3.76 933.3 GB/s	$10.64 330 TOPs	$3,510	37
NVIDIA A40 48GB	$155.69 37.4 TFLOPs	$155.69 37.4 TFLOPs	$17.33 336 Cores	$121.31 48 GB	$8.37 696 GB/s	$19.46 299.3 TOPs	$5,823	26
NVIDIA A10 24GB	$57.53 31.2 TFLOPs	$14.36 125 TFLOPs	$6.23 288 Cores	$74.79 24 GB	$2.99 600 GB/s	$7.18 250 TOPs	$1,795	66
NVIDIA L40 48GB	$55.19 90.5 TFLOPs	$27.59 181.05 TFLOPs	$8.79 568 Cores	$104.06 48 GB	$5.78 864 GB/s	$13.80 362 TOPs	$4,995	41
AMD Radeon RX 7900 XT 20GB	$13.17 52 TFLOPs	$6.65 103 TFLOPs	$4.08 168 Cores	$34.25 20 GB	$0.86 800 GB/s	$6.65 103 TOPs	$685	59
NVIDIA L4 24GB	$16.67 120 TFLOPs	$8.26 242 TFLOPs	$8.33 240 Cores	$83.33 24 GB	$6.67 300 GB/s	$4.12 485 TOPs	$2,000	36
NVIDIA RTX A5000 24GB	$47.89 27.77 TFLOPs	$47.89 27.77 TFLOPs	$5.20 256 Cores	$55.42 24 GB	$1.73 768 GB/s	$2.99 444.4 TOPs	$1,330	66
NVIDIA A100 PCIe 80GB	$115.38 156 TFLOPs	$57.69 312 TFLOPs	$41.66 432 Cores	$224.99 80 GB	$9.30 1935 GB/s	$28.84 624 TOPs	$17,999	19
NVIDIA Tesla P100 16GB	$2.98 10.6 TFLOPs	$1.49 21.2 TFLOPs	$∞ n/a	$1.98 16 GB	$0.04 732 GB/s	$∞ n/a	$32	100
NVIDIA Geforce RTX 4090 24GB	$27.23 82.6 TFLOPs	$3.40 660.6 TFLOPs	$4.39 512 Cores	$93.71 24 GB	$2.23 1008 GB/s	$1.70 1321.2 TOPs	$2,249	99
NVIDIA Tesla V100 32GB	$124.30 14 TFLOPs	$62.15 28 TFLOPs	$2.72 640 Cores	$54.38 32 GB	$1.93 900 GB/s	$31.08 56 TOPs	$1,740	34
NVIDIA H100 PCIe 80GB	$35.39 756 TFLOPs	$17.68 1513 TFLOPs	$58.67 456 Cores	$334.43 80 GB	$13.12 2039 GB/s	$8.84 3026 TOPs	$26,755	11
AMD Radeon RX 7900 XTX 24GB	$16.39 61 TFLOPs	$8.13 123 TFLOPs	$5.21 192 Cores	$41.67 24 GB	$1.04 960 GB/s	$8.13 123 TOPs	$1,000	74
NVIDIA L40S 48GB	$43.69 183 TFLOPs	$22.09 362 TFLOPs	$14.08 568 Cores	$166.56 48 GB	$9.25 864 GB/s	$5.45 1466 TOPs	$7,995	27
NVIDIA Tesla V100 16GB	$46.43 14 TFLOPs	$23.21 28 TFLOPs	$1.02 640 Cores	$40.63 16 GB	$0.72 900 GB/s	$11.61 56 TOPs	$650	45
AMD Radeon RX 7700 XT 12GB	$12.86 35 TFLOPs	$6.43 70 TFLOPs	$4.17 108 Cores	$37.50 12 GB	$1.04 432 GB/s	$∞ n/a	$450	37
AMD Radeon RX 7800 XT 16GB	$15.67 37 TFLOPs	$7.84 74 TFLOPs	$4.83 120 Cores	$36.25 16 GB	$0.93 624 GB/s	$∞ n/a	$580	55
AMD Radeon RX 7600 XT 16GB	$20.10 22.57 TFLOPs	$10.05 45.14 TFLOPs	$7.09 64 Cores	$28.35 16 GB	$1.58 288 GB/s	$∞ n/a	$454	10
NVIDIA GeForce RTX 5080 16GB	$13.76 112.6 TFLOPs	$3.44 450.2 TFLOPs	$4.61 336 Cores	$96.81 16 GB	$1.61 960 GB/s	$1.72 900.4 TOPs	$1,549	94
NVIDIA GeForce RTX 5090 32GB	$9.30 209.5 TFLOPs	$2.33 838 TFLOPs	$2.87 680 Cores	$60.89 32 GB	$1.09 1792 GB/s	$1.16 1676 TOPs	$1,949	47
NVIDIA GeForce RTX 5070 Ti 16GB	$9.64 112.6 TFLOPs	$2.41 450.2 TFLOPs	$3.23 336 Cores	$67.81 16 GB	$1.13 960 GB/s	$1.21 900.4 TOPs	$1,085	87
NVIDIA Geforce RTX 4070 12GB	$8.57 58.2 TFLOPs	$2.14 233.2 TFLOPs	$2.71 184 Cores	$41.54 12 GB	$0.99 504 GB/s	$1.07 466.4 TOPs	$499	45
NVIDIA Geforce RTX 4070 Ti 12GB	$9.98 80.2 TFLOPs	$2.49 320.8 TFLOPs	$3.33 240 Cores	$66.67 12 GB	$1.59 504 GB/s	$1.25 641.4 TOPs	$800	30
NVIDIA Geforce RTX 4080 16GB	$14.25 97.4 TFLOPs	$3.48 398.8 TFLOPs	$4.57 304 Cores	$86.75 16 GB	$1.94 716.8 GB/s	$1.78 779.82 TOPs	$1,388	81