GPUs Ranked by Cost per FP16 TFLOPs

Something missing? Let us know and we'll add it if we can.

GPU	$ / FP32 TFLOPs	$ / FP16 TFLOPs	$ / Tensor Core Count	$ / Memory Capacity (GB)	$ / Memory Bandwidth (GB/s)	$ / Int8 TOPs	Minimum Price	Available for Sale
NVIDIA T4 16GB	$71.60 8.1 TFLOPs	$8.92 65 TFLOPs	$1.81 320 Cores	$36.25 16 GB	$1.81 320 GB/s	$4.46 130 TOPs	$580	85
NVIDIA A30 24GB	$17.88 165 TFLOPs	$17.88 165 TFLOPs	$13.17 224 Cores	$122.92 24 GB	$3.16 933.3 GB/s	$8.94 330 TOPs	$2,950	46
NVIDIA A40 48GB	$112.30 37.4 TFLOPs	$112.30 37.4 TFLOPs	$12.50 336 Cores	$87.50 48 GB	$6.03 696 GB/s	$14.03 299.3 TOPs	$4,200	37
NVIDIA A10 24GB	$35.26 31.2 TFLOPs	$8.80 125 TFLOPs	$3.82 288 Cores	$45.83 24 GB	$1.83 600 GB/s	$4.40 250 TOPs	$1,100	71
NVIDIA L40 48GB	$55.19 90.5 TFLOPs	$27.59 181.05 TFLOPs	$8.79 568 Cores	$104.06 48 GB	$5.78 864 GB/s	$13.80 362 TOPs	$4,995	27
AMD Radeon RX 7900 XT 20GB	$10.58 52 TFLOPs	$5.34 103 TFLOPs	$3.27 168 Cores	$27.50 20 GB	$0.69 800 GB/s	$5.34 103 TOPs	$550	94
NVIDIA L4 24GB	$14.83 120 TFLOPs	$7.36 242 TFLOPs	$7.42 240 Cores	$74.17 24 GB	$5.93 300 GB/s	$3.67 485 TOPs	$1,780	55
NVIDIA RTX A5000 24GB	$50.41 27.77 TFLOPs	$50.41 27.77 TFLOPs	$5.47 256 Cores	$58.33 24 GB	$1.82 768 GB/s	$3.15 444.4 TOPs	$1,400	68
NVIDIA A100 PCIe 80GB	$62.18 156 TFLOPs	$31.09 312 TFLOPs	$22.45 432 Cores	$121.25 80 GB	$5.01 1935 GB/s	$15.54 624 TOPs	$9,700	14
NVIDIA Tesla P100 16GB	$9.24 10.6 TFLOPs	$4.62 21.2 TFLOPs	$∞ n/a	$6.12 16 GB	$0.13 732 GB/s	$∞ n/a	$98	100
NVIDIA Geforce RTX 4090 24GB	$0.96 82.6 TFLOPs	$0.12 660.6 TFLOPs	$0.15 512 Cores	$3.29 24 GB	$0.08 1008 GB/s	$0.06 1321.2 TOPs	$79	100
NVIDIA Tesla V100 32GB	$50.00 14 TFLOPs	$25.00 28 TFLOPs	$1.09 640 Cores	$21.87 32 GB	$0.78 900 GB/s	$12.50 56 TOPs	$700	60
NVIDIA H100 PCIe 80GB	$36.45 756 TFLOPs	$18.21 1513 TFLOPs	$60.42 456 Cores	$344.41 80 GB	$13.51 2039 GB/s	$9.11 3026 TOPs	$27,553	12
AMD Radeon RX 7900 XTX 24GB	$10.58 61 TFLOPs	$5.25 123 TFLOPs	$3.36 192 Cores	$26.88 24 GB	$0.67 960 GB/s	$5.25 123 TOPs	$645	100
NVIDIA L40S 48GB	$38.25 183 TFLOPs	$19.34 362 TFLOPs	$12.32 568 Cores	$145.83 48 GB	$8.10 864 GB/s	$4.77 1466 TOPs	$7,000	34
NVIDIA Tesla V100 16GB	$20.00 14 TFLOPs	$10.00 28 TFLOPs	$0.44 640 Cores	$17.50 16 GB	$0.31 900 GB/s	$5.00 56 TOPs	$280	69
AMD Radeon RX 7700 XT 12GB	$8.57 35 TFLOPs	$4.29 70 TFLOPs	$2.78 108 Cores	$25.00 12 GB	$0.69 432 GB/s	$∞ n/a	$300	58
AMD Radeon RX 7800 XT 16GB	$10.92 37 TFLOPs	$5.46 74 TFLOPs	$3.37 120 Cores	$25.25 16 GB	$0.65 624 GB/s	$∞ n/a	$404	75
AMD Radeon RX 7600 XT 16GB	$13.29 22.57 TFLOPs	$6.65 45.14 TFLOPs	$4.69 64 Cores	$18.75 16 GB	$1.04 288 GB/s	$∞ n/a	$300	17
NVIDIA GeForce RTX 5080 16GB	$7.55 112.6 TFLOPs	$1.89 450.2 TFLOPs	$2.53 336 Cores	$53.13 16 GB	$0.89 960 GB/s	$0.94 900.4 TOPs	$850	99
NVIDIA GeForce RTX 5090 32GB	$11.45 209.5 TFLOPs	$2.86 838 TFLOPs	$3.53 680 Cores	$74.94 32 GB	$1.34 1792 GB/s	$1.43 1676 TOPs	$2,398	100
NVIDIA GeForce RTX 5070 Ti 16GB	$6.64 112.6 TFLOPs	$1.66 450.2 TFLOPs	$2.23 336 Cores	$46.75 16 GB	$0.78 960 GB/s	$0.83 900.4 TOPs	$748	98
NVIDIA Geforce RTX 4070 12GB	$6.01 58.2 TFLOPs	$1.50 233.2 TFLOPs	$1.90 184 Cores	$29.16 12 GB	$0.69 504 GB/s	$0.75 466.4 TOPs	$350	99
NVIDIA Geforce RTX 4070 Ti 12GB	$4.99 80.2 TFLOPs	$1.25 320.8 TFLOPs	$1.67 240 Cores	$33.33 12 GB	$0.79 504 GB/s	$0.62 641.4 TOPs	$400	32
NVIDIA Geforce RTX 4080 16GB	$7.80 97.4 TFLOPs	$1.91 398.8 TFLOPs	$2.50 304 Cores	$47.50 16 GB	$1.06 716.8 GB/s	$0.97 779.82 TOPs	$760	100