GPUs Ranked by Cost per FP16 TFLOPs

Something missing? Let us know and we'll add it if we can.

GPU	$ / FP32 TFLOPs	$ / FP16 TFLOPs	$ / Tensor Core Count	$ / Memory Capacity (GB)	$ / Memory Bandwidth (GB/s)	$ / Int8 TOPs	Minimum Price	Available for Sale
NVIDIA T4 16GB	$67.90 8.1 TFLOPs	$8.46 65 TFLOPs	$1.72 320 Cores	$34.38 16 GB	$1.72 320 GB/s	$4.23 130 TOPs	$550	87
NVIDIA A30 24GB	$19.27 165 TFLOPs	$19.27 165 TFLOPs	$14.20 224 Cores	$132.50 24 GB	$3.41 933.3 GB/s	$9.64 330 TOPs	$3,180	44
NVIDIA A40 48GB	$112.30 37.4 TFLOPs	$112.30 37.4 TFLOPs	$12.50 336 Cores	$87.50 48 GB	$6.03 696 GB/s	$14.03 299.3 TOPs	$4,200	35
NVIDIA A10 24GB	$44.23 31.2 TFLOPs	$11.04 125 TFLOPs	$4.79 288 Cores	$57.50 24 GB	$2.30 600 GB/s	$5.52 250 TOPs	$1,380	64
NVIDIA L40 48GB	$59.12 90.5 TFLOPs	$29.55 181.05 TFLOPs	$9.42 568 Cores	$111.46 48 GB	$6.19 864 GB/s	$14.78 362 TOPs	$5,350	28
AMD Radeon RX 7900 XT 20GB	$9.62 52 TFLOPs	$4.85 103 TFLOPs	$2.98 168 Cores	$25.00 20 GB	$0.63 800 GB/s	$4.85 103 TOPs	$500	92
NVIDIA L4 24GB	$15.42 120 TFLOPs	$7.64 242 TFLOPs	$7.71 240 Cores	$77.08 24 GB	$6.17 300 GB/s	$3.81 485 TOPs	$1,850	51
NVIDIA RTX A5000 24GB	$53.98 27.77 TFLOPs	$53.98 27.77 TFLOPs	$5.86 256 Cores	$62.46 24 GB	$1.95 768 GB/s	$3.37 444.4 TOPs	$1,499	77
NVIDIA A100 PCIe 80GB	$66.99 156 TFLOPs	$33.49 312 TFLOPs	$24.19 432 Cores	$130.63 80 GB	$5.40 1935 GB/s	$16.75 624 TOPs	$10,450	12
NVIDIA Tesla P100 16GB	$9.24 10.6 TFLOPs	$4.62 21.2 TFLOPs	$∞ n/a	$6.12 16 GB	$0.13 732 GB/s	$∞ n/a	$98	98
NVIDIA Geforce RTX 4090 24GB	$0.96 82.6 TFLOPs	$0.12 660.6 TFLOPs	$0.15 512 Cores	$3.29 24 GB	$0.08 1008 GB/s	$0.06 1321.2 TOPs	$79	99
NVIDIA Tesla V100 32GB	$71.36 14 TFLOPs	$35.68 28 TFLOPs	$1.56 640 Cores	$31.22 32 GB	$1.11 900 GB/s	$17.84 56 TOPs	$999	56
NVIDIA H100 PCIe 80GB	$36.91 756 TFLOPs	$18.44 1513 TFLOPs	$61.19 456 Cores	$348.81 80 GB	$13.69 2039 GB/s	$9.22 3026 TOPs	$27,905	10
AMD Radeon RX 7900 XTX 24GB	$10.64 61 TFLOPs	$5.28 123 TFLOPs	$3.38 192 Cores	$27.04 24 GB	$0.68 960 GB/s	$5.28 123 TOPs	$649	100
NVIDIA L40S 48GB	$38.25 183 TFLOPs	$19.34 362 TFLOPs	$12.32 568 Cores	$145.83 48 GB	$8.10 864 GB/s	$4.77 1466 TOPs	$7,000	36
NVIDIA Tesla V100 16GB	$23.57 14 TFLOPs	$11.79 28 TFLOPs	$0.52 640 Cores	$20.63 16 GB	$0.37 900 GB/s	$5.89 56 TOPs	$330	64
AMD Radeon RX 7700 XT 12GB	$10.71 35 TFLOPs	$5.36 70 TFLOPs	$3.47 108 Cores	$31.25 12 GB	$0.87 432 GB/s	$∞ n/a	$375	51
AMD Radeon RX 7800 XT 16GB	$11.89 37 TFLOPs	$5.95 74 TFLOPs	$3.67 120 Cores	$27.50 16 GB	$0.71 624 GB/s	$∞ n/a	$440	71
AMD Radeon RX 7600 XT 16GB	$14.18 22.57 TFLOPs	$7.09 45.14 TFLOPs	$5.00 64 Cores	$20.00 16 GB	$1.11 288 GB/s	$∞ n/a	$320	15
NVIDIA GeForce RTX 5080 16GB	$8.26 112.6 TFLOPs	$2.07 450.2 TFLOPs	$2.77 336 Cores	$58.12 16 GB	$0.97 960 GB/s	$1.03 900.4 TOPs	$930	98
NVIDIA GeForce RTX 5090 32GB	$11.22 209.5 TFLOPs	$2.80 838 TFLOPs	$3.46 680 Cores	$73.44 32 GB	$1.31 1792 GB/s	$1.40 1676 TOPs	$2,350	100
NVIDIA GeForce RTX 5070 Ti 16GB	$6.57 112.6 TFLOPs	$1.64 450.2 TFLOPs	$2.20 336 Cores	$46.22 16 GB	$0.77 960 GB/s	$0.82 900.4 TOPs	$740	100
NVIDIA Geforce RTX 4070 12GB	$7.39 58.2 TFLOPs	$1.84 233.2 TFLOPs	$2.34 184 Cores	$35.83 12 GB	$0.85 504 GB/s	$0.92 466.4 TOPs	$430	100
NVIDIA Geforce RTX 4070 Ti 12GB	$7.22 80.2 TFLOPs	$1.80 320.8 TFLOPs	$2.41 240 Cores	$48.25 12 GB	$1.15 504 GB/s	$0.90 641.4 TOPs	$579	34
NVIDIA Geforce RTX 4080 16GB	$8.01 97.4 TFLOPs	$1.96 398.8 TFLOPs	$2.57 304 Cores	$48.75 16 GB	$1.09 716.8 GB/s	$1.00 779.82 TOPs	$780	96