GPUs Ranked by Cost per FP16 TFLOPs

Something missing? Let us know and we'll add it if we can.

GPU	$ / FP32 TFLOPs	$ / FP16 TFLOPs	$ / Tensor Core Count	$ / Memory Capacity (GB)	$ / Memory Bandwidth (GB/s)	$ / Int8 TOPs	Minimum Price	Available for Sale
NVIDIA T4 16GB	$74.07 8.1 TFLOPs	$9.23 65 TFLOPs	$1.87 320 Cores	$37.50 16 GB	$1.87 320 GB/s	$4.62 130 TOPs	$600	84
NVIDIA A30 24GB	$13.94 165 TFLOPs	$13.94 165 TFLOPs	$10.27 224 Cores	$95.83 24 GB	$2.46 933.3 GB/s	$6.97 330 TOPs	$2,300	43
NVIDIA A40 48GB	$140.37 37.4 TFLOPs	$140.37 37.4 TFLOPs	$15.63 336 Cores	$109.38 48 GB	$7.54 696 GB/s	$17.54 299.3 TOPs	$5,250	27
NVIDIA A10 24GB	$41.67 31.2 TFLOPs	$10.40 125 TFLOPs	$4.51 288 Cores	$54.17 24 GB	$2.17 600 GB/s	$5.20 250 TOPs	$1,300	65
NVIDIA L40 48GB	$60.22 90.5 TFLOPs	$30.10 181.05 TFLOPs	$9.60 568 Cores	$113.54 48 GB	$6.31 864 GB/s	$15.06 362 TOPs	$5,450	27
AMD Radeon RX 7900 XT 20GB	$11.44 52 TFLOPs	$5.78 103 TFLOPs	$3.54 168 Cores	$29.75 20 GB	$0.74 800 GB/s	$5.78 103 TOPs	$595	77
NVIDIA L4 24GB	$15.63 120 TFLOPs	$7.75 242 TFLOPs	$7.81 240 Cores	$78.13 24 GB	$6.25 300 GB/s	$3.87 485 TOPs	$1,875	54
NVIDIA RTX A5000 24GB	$43.21 27.77 TFLOPs	$43.21 27.77 TFLOPs	$4.69 256 Cores	$50.00 24 GB	$1.56 768 GB/s	$2.70 444.4 TOPs	$1,200	85
NVIDIA A100 PCIe 80GB	$67.31 156 TFLOPs	$33.65 312 TFLOPs	$24.31 432 Cores	$131.25 80 GB	$5.43 1935 GB/s	$16.83 624 TOPs	$10,500	12
NVIDIA Tesla P100 16GB	$11.46 10.6 TFLOPs	$5.73 21.2 TFLOPs	$∞ n/a	$7.59 16 GB	$0.17 732 GB/s	$∞ n/a	$121	98
NVIDIA Geforce RTX 4090 24GB	$27.12 82.6 TFLOPs	$3.39 660.6 TFLOPs	$4.37 512 Cores	$93.33 24 GB	$2.22 1008 GB/s	$1.70 1321.2 TOPs	$2,240	92
NVIDIA Tesla V100 32GB	$85.71 14 TFLOPs	$42.86 28 TFLOPs	$1.87 640 Cores	$37.50 32 GB	$1.33 900 GB/s	$21.43 56 TOPs	$1,200	43
NVIDIA H100 PCIe 80GB	$26.45 756 TFLOPs	$13.22 1513 TFLOPs	$43.86 456 Cores	$249.99 80 GB	$9.81 2039 GB/s	$6.61 3026 TOPs	$19,999	11
AMD Radeon RX 7900 XTX 24GB	$11.48 61 TFLOPs	$5.69 123 TFLOPs	$3.65 192 Cores	$29.17 24 GB	$0.73 960 GB/s	$5.69 123 TOPs	$700	100
NVIDIA L40S 48GB	$42.35 183 TFLOPs	$21.41 362 TFLOPs	$13.64 568 Cores	$161.46 48 GB	$8.97 864 GB/s	$5.29 1466 TOPs	$7,750	27
NVIDIA Tesla V100 16GB	$31.34 14 TFLOPs	$15.67 28 TFLOPs	$0.69 640 Cores	$27.42 16 GB	$0.49 900 GB/s	$7.83 56 TOPs	$439	58
AMD Radeon RX 7700 XT 12GB	$10.00 35 TFLOPs	$5.00 70 TFLOPs	$3.24 108 Cores	$29.17 12 GB	$0.81 432 GB/s	$∞ n/a	$350	44
AMD Radeon RX 7800 XT 16GB	$12.43 37 TFLOPs	$6.22 74 TFLOPs	$3.83 120 Cores	$28.75 16 GB	$0.74 624 GB/s	$∞ n/a	$460	64
AMD Radeon RX 7600 XT 16GB	$13.29 22.57 TFLOPs	$6.65 45.14 TFLOPs	$4.69 64 Cores	$18.75 16 GB	$1.04 288 GB/s	$∞ n/a	$300	12
NVIDIA GeForce RTX 5080 16GB	$10.21 112.6 TFLOPs	$2.55 450.2 TFLOPs	$3.42 336 Cores	$71.87 16 GB	$1.20 960 GB/s	$1.28 900.4 TOPs	$1,150	98
NVIDIA GeForce RTX 5090 32GB	$11.16 209.5 TFLOPs	$2.79 838 TFLOPs	$3.44 680 Cores	$73.05 32 GB	$1.30 1792 GB/s	$1.39 1676 TOPs	$2,338	95
NVIDIA GeForce RTX 5070 Ti 16GB	$7.45 112.6 TFLOPs	$1.86 450.2 TFLOPs	$2.50 336 Cores	$52.44 16 GB	$0.87 960 GB/s	$0.93 900.4 TOPs	$839	98
NVIDIA Geforce RTX 4070 12GB	$8.25 58.2 TFLOPs	$2.06 233.2 TFLOPs	$2.61 184 Cores	$40.00 12 GB	$0.95 504 GB/s	$1.03 466.4 TOPs	$480	100
NVIDIA Geforce RTX 4070 Ti 12GB	$9.03 80.2 TFLOPs	$2.26 320.8 TFLOPs	$3.02 240 Cores	$60.38 12 GB	$1.44 504 GB/s	$1.13 641.4 TOPs	$725	24
NVIDIA Geforce RTX 4080 16GB	$8.44 97.4 TFLOPs	$2.06 398.8 TFLOPs	$2.70 304 Cores	$51.38 16 GB	$1.15 716.8 GB/s	$1.05 779.82 TOPs	$822	100