GPUs Ranked by Cost per FP16 TFLOPs

Something missing? Let us know and we'll add it if we can.

GPU	$ / FP32 TFLOPs	$ / FP16 TFLOPs	$ / Tensor Core Count	$ / Memory Capacity (GB)	$ / Memory Bandwidth (GB/s)	$ / Int8 TOPs	Minimum Price	Available for Sale
NVIDIA T4 16GB	$74.07 8.1 TFLOPs	$9.23 65 TFLOPs	$1.88 320 Cores	$37.50 16 GB	$1.88 320 GB/s	$4.62 130 TOPs	$600	87
NVIDIA A30 24GB	$19.99 165 TFLOPs	$19.99 165 TFLOPs	$14.73 224 Cores	$137.46 24 GB	$3.53 933.3 GB/s	$10.00 330 TOPs	$3,299	41
NVIDIA A40 48GB	$120.32 37.4 TFLOPs	$120.32 37.4 TFLOPs	$13.39 336 Cores	$93.75 48 GB	$6.47 696 GB/s	$15.04 299.3 TOPs	$4,500	32
NVIDIA A10 24GB	$44.84 31.2 TFLOPs	$11.19 125 TFLOPs	$4.86 288 Cores	$58.29 24 GB	$2.33 600 GB/s	$5.60 250 TOPs	$1,399	68
NVIDIA L40 48GB	$60.22 90.5 TFLOPs	$30.10 181.05 TFLOPs	$9.60 568 Cores	$113.54 48 GB	$6.31 864 GB/s	$15.06 362 TOPs	$5,450	61
AMD Radeon RX 7900 XT 20GB	$10.37 52 TFLOPs	$5.23 103 TFLOPs	$3.21 168 Cores	$26.95 20 GB	$0.67 800 GB/s	$5.23 103 TOPs	$539	87
NVIDIA L4 24GB	$15.82 120 TFLOPs	$7.84 242 TFLOPs	$7.91 240 Cores	$79.08 24 GB	$6.33 300 GB/s	$3.91 485 TOPs	$1,898	51
NVIDIA RTX A5000 24GB	$46.74 27.77 TFLOPs	$46.74 27.77 TFLOPs	$5.07 256 Cores	$54.08 24 GB	$1.69 768 GB/s	$2.92 444.4 TOPs	$1,298	75
NVIDIA A100 PCIe 80GB	$66.99 156 TFLOPs	$33.49 312 TFLOPs	$24.19 432 Cores	$130.63 80 GB	$5.40 1935 GB/s	$16.75 624 TOPs	$10,450	11
NVIDIA Tesla P100 16GB	$9.55 10.6 TFLOPs	$4.77 21.2 TFLOPs	$∞ n/a	$6.33 16 GB	$0.14 732 GB/s	$∞ n/a	$101	98
NVIDIA Geforce RTX 4090 24GB	$25.42 82.6 TFLOPs	$3.18 660.6 TFLOPs	$4.10 512 Cores	$87.50 24 GB	$2.08 1008 GB/s	$1.59 1321.2 TOPs	$2,100	98
NVIDIA Tesla V100 32GB	$77.30 14 TFLOPs	$38.65 28 TFLOPs	$1.69 640 Cores	$33.82 32 GB	$1.20 900 GB/s	$19.33 56 TOPs	$1,082	52
NVIDIA H100 PCIe 80GB	$36.97 756 TFLOPs	$18.47 1513 TFLOPs	$61.30 456 Cores	$349.39 80 GB	$13.71 2039 GB/s	$9.24 3026 TOPs	$27,951	10
AMD Radeon RX 7900 XTX 24GB	$11.64 61 TFLOPs	$5.77 123 TFLOPs	$3.70 192 Cores	$29.58 24 GB	$0.74 960 GB/s	$5.77 123 TOPs	$710	99
NVIDIA L40S 48GB	n/a 183 TFLOPs	n/a 362 TFLOPs	n/a 568 Cores	n/a 48 GB	n/a 864 GB/s	n/a 1466 TOPs	n/a	0
NVIDIA Tesla V100 16GB	$16.07 14 TFLOPs	$8.04 28 TFLOPs	$0.35 640 Cores	$14.06 16 GB	$0.25 900 GB/s	$4.02 56 TOPs	$225	64
AMD Radeon RX 7700 XT 12GB	$10.00 35 TFLOPs	$5.00 70 TFLOPs	$3.24 108 Cores	$29.17 12 GB	$0.81 432 GB/s	$∞ n/a	$350	56
AMD Radeon RX 7800 XT 16GB	$13.24 37 TFLOPs	$6.62 74 TFLOPs	$4.08 120 Cores	$30.63 16 GB	$0.79 624 GB/s	$∞ n/a	$490	65
AMD Radeon RX 7600 XT 16GB	$13.74 22.57 TFLOPs	$6.87 45.14 TFLOPs	$4.84 64 Cores	$19.38 16 GB	$1.08 288 GB/s	$∞ n/a	$310	19
NVIDIA GeForce RTX 5080 16GB	$8.88 112.6 TFLOPs	$2.22 450.2 TFLOPs	$2.98 336 Cores	$62.50 16 GB	$1.04 960 GB/s	$1.11 900.4 TOPs	$1,000	98
NVIDIA GeForce RTX 5090 32GB	$10.97 209.5 TFLOPs	$2.74 838 TFLOPs	$3.38 680 Cores	$71.84 32 GB	$1.28 1792 GB/s	$1.37 1676 TOPs	$2,299	100
NVIDIA GeForce RTX 5070 Ti 16GB	$7.10 112.6 TFLOPs	$1.78 450.2 TFLOPs	$2.38 336 Cores	$50.00 16 GB	$0.83 960 GB/s	$0.89 900.4 TOPs	$800	100
NVIDIA Geforce RTX 4070 12GB	$8.16 58.2 TFLOPs	$2.04 233.2 TFLOPs	$2.58 184 Cores	$39.58 12 GB	$0.94 504 GB/s	$1.02 466.4 TOPs	$475	97
NVIDIA Geforce RTX 4070 Ti 12GB	$7.22 80.2 TFLOPs	$1.80 320.8 TFLOPs	$2.41 240 Cores	$48.25 12 GB	$1.15 504 GB/s	$0.90 641.4 TOPs	$579	32
NVIDIA Geforce RTX 4080 16GB	$8.52 97.4 TFLOPs	$2.08 398.8 TFLOPs	$2.73 304 Cores	$51.87 16 GB	$1.16 716.8 GB/s	$1.06 779.82 TOPs	$830	98