GPUs Ranked by Cost per FP16 TFLOPs

Something missing? Let us know and we'll add it if we can.

GPU	$ / FP32 TFLOPs	$ / FP16 TFLOPs	$ / Tensor Core Count	$ / Memory Capacity (GB)	$ / Memory Bandwidth (GB/s)	$ / Int8 TOPs	Minimum Price	Available for Sale
NVIDIA T4 16GB	$67.90 8.1 TFLOPs	$8.46 65 TFLOPs	$1.72 320 Cores	$34.37 16 GB	$1.72 320 GB/s	$4.23 130 TOPs	$550	89
NVIDIA A30 24GB	$13.94 165 TFLOPs	$13.94 165 TFLOPs	$10.27 224 Cores	$95.83 24 GB	$2.46 933.3 GB/s	$6.97 330 TOPs	$2,300	35
NVIDIA A40 48GB	$198.66 37.4 TFLOPs	$198.66 37.4 TFLOPs	$22.11 336 Cores	$154.79 48 GB	$10.68 696 GB/s	$24.82 299.3 TOPs	$7,430	24
NVIDIA A10 24GB	$41.63 31.2 TFLOPs	$10.39 125 TFLOPs	$4.51 288 Cores	$54.13 24 GB	$2.17 600 GB/s	$5.20 250 TOPs	$1,299	63
NVIDIA L40 48GB	$60.50 90.5 TFLOPs	$30.24 181.05 TFLOPs	$9.64 568 Cores	$114.06 48 GB	$6.34 864 GB/s	$15.12 362 TOPs	$5,475	26
AMD Radeon RX 7900 XT 20GB	$12.79 52 TFLOPs	$6.46 103 TFLOPs	$3.96 168 Cores	$33.25 20 GB	$0.83 800 GB/s	$6.46 103 TOPs	$665	74
NVIDIA L4 24GB	$17.32 120 TFLOPs	$8.59 242 TFLOPs	$8.66 240 Cores	$86.58 24 GB	$6.93 300 GB/s	$4.28 485 TOPs	$2,078	33
NVIDIA RTX A5000 24GB	$48.58 27.77 TFLOPs	$48.58 27.77 TFLOPs	$5.27 256 Cores	$56.21 24 GB	$1.76 768 GB/s	$3.04 444.4 TOPs	$1,349	74
NVIDIA A100 PCIe 80GB	$102.56 156 TFLOPs	$51.28 312 TFLOPs	$37.03 432 Cores	$199.99 80 GB	$8.27 1935 GB/s	$25.64 624 TOPs	$15,999	12
NVIDIA Tesla P100 16GB	$16.51 10.6 TFLOPs	$8.25 21.2 TFLOPs	$∞ n/a	$10.94 16 GB	$0.24 732 GB/s	$∞ n/a	$175	100
NVIDIA Geforce RTX 4090 24GB	$26.62 82.6 TFLOPs	$3.33 660.6 TFLOPs	$4.29 512 Cores	$91.63 24 GB	$2.18 1008 GB/s	$1.66 1321.2 TOPs	$2,199	97
NVIDIA Tesla V100 32GB	$114.29 14 TFLOPs	$57.14 28 TFLOPs	$2.50 640 Cores	$50.00 32 GB	$1.78 900 GB/s	$28.57 56 TOPs	$1,600	30
NVIDIA H100 PCIe 80GB	$38.35 756 TFLOPs	$19.16 1513 TFLOPs	$63.59 456 Cores	$362.44 80 GB	$14.22 2039 GB/s	$9.58 3026 TOPs	$28,995	12
AMD Radeon RX 7900 XTX 24GB	$14.26 61 TFLOPs	$7.07 123 TFLOPs	$4.53 192 Cores	$36.25 24 GB	$0.91 960 GB/s	$7.07 123 TOPs	$870	100
NVIDIA L40S 48GB	$44.72 183 TFLOPs	$22.60 362 TFLOPs	$14.41 568 Cores	$170.48 48 GB	$9.47 864 GB/s	$5.58 1466 TOPs	$8,183	26
NVIDIA Tesla V100 16GB	$35.71 14 TFLOPs	$17.86 28 TFLOPs	$0.78 640 Cores	$31.25 16 GB	$0.56 900 GB/s	$8.93 56 TOPs	$500	51
AMD Radeon RX 7700 XT 12GB	$11.43 35 TFLOPs	$5.71 70 TFLOPs	$3.70 108 Cores	$33.33 12 GB	$0.93 432 GB/s	$∞ n/a	$400	43
AMD Radeon RX 7800 XT 16GB	$13.51 37 TFLOPs	$6.76 74 TFLOPs	$4.17 120 Cores	$31.25 16 GB	$0.80 624 GB/s	$∞ n/a	$500	61
AMD Radeon RX 7600 XT 16GB	$19.05 22.57 TFLOPs	$9.53 45.14 TFLOPs	$6.72 64 Cores	$26.87 16 GB	$1.49 288 GB/s	$∞ n/a	$430	9
NVIDIA GeForce RTX 5080 16GB	$11.80 112.6 TFLOPs	$2.95 450.2 TFLOPs	$3.96 336 Cores	$83.06 16 GB	$1.38 960 GB/s	$1.48 900.4 TOPs	$1,329	98
NVIDIA GeForce RTX 5090 32GB	$14.08 209.5 TFLOPs	$3.52 838 TFLOPs	$4.34 680 Cores	$92.16 32 GB	$1.65 1792 GB/s	$1.76 1676 TOPs	$2,949	85
NVIDIA GeForce RTX 5070 Ti 16GB	$7.99 112.6 TFLOPs	$2.00 450.2 TFLOPs	$2.68 336 Cores	$56.20 16 GB	$0.94 960 GB/s	$1.00 900.4 TOPs	$899	99
NVIDIA Geforce RTX 4070 12GB	$9.45 58.2 TFLOPs	$2.36 233.2 TFLOPs	$2.99 184 Cores	$45.83 12 GB	$1.09 504 GB/s	$1.18 466.4 TOPs	$550	96
NVIDIA Geforce RTX 4070 Ti 12GB	$14.01 80.2 TFLOPs	$3.50 320.8 TFLOPs	$4.68 240 Cores	$93.67 12 GB	$2.23 504 GB/s	$1.75 641.4 TOPs	$1,124	11
NVIDIA Geforce RTX 4080 16GB	$9.52 97.4 TFLOPs	$2.32 398.8 TFLOPs	$3.05 304 Cores	$57.95 16 GB	$1.29 716.8 GB/s	$1.19 779.82 TOPs	$927	88