GPUs Ranked by Cost per FP16 TFLOPs

Something missing? Let us know and we'll add it if we can.

GPU	$ / FP32 TFLOPs	$ / FP16 TFLOPs	$ / Tensor Core Count	$ / Memory Capacity (GB)	$ / Memory Bandwidth (GB/s)	$ / Int8 TOPs	Minimum Price	Available for Sale
NVIDIA T4 16GB	$59.26 8.1 TFLOPs	$7.38 65 TFLOPs	$1.50 320 Cores	$30.00 16 GB	$1.50 320 GB/s	$3.69 130 TOPs	$480	80
NVIDIA A30 24GB	$18.15 165 TFLOPs	$18.15 165 TFLOPs	$13.37 224 Cores	$124.79 24 GB	$3.21 933.3 GB/s	$9.08 330 TOPs	$2,995	37
NVIDIA A40 48GB	$106.95 37.4 TFLOPs	$106.95 37.4 TFLOPs	$11.90 336 Cores	$83.33 48 GB	$5.75 696 GB/s	$13.36 299.3 TOPs	$4,000	27
NVIDIA A10 24GB	$50.90 31.2 TFLOPs	$12.71 125 TFLOPs	$5.51 288 Cores	$66.18 24 GB	$2.65 600 GB/s	$6.35 250 TOPs	$1,588	64
NVIDIA L40 48GB	$60.62 90.5 TFLOPs	$30.30 181.05 TFLOPs	$9.66 568 Cores	$114.29 48 GB	$6.35 864 GB/s	$15.15 362 TOPs	$5,486	29
AMD Radeon RX 7900 XT 20GB	$11.54 52 TFLOPs	$5.83 103 TFLOPs	$3.57 168 Cores	$30.00 20 GB	$0.75 800 GB/s	$5.83 103 TOPs	$600	47
NVIDIA L4 24GB	$7.92 120 TFLOPs	$3.93 242 TFLOPs	$3.96 240 Cores	$39.58 24 GB	$3.17 300 GB/s	$1.96 485 TOPs	$950	37
NVIDIA RTX A5000 24GB	$35.94 27.77 TFLOPs	$35.94 27.77 TFLOPs	$3.90 256 Cores	$41.58 24 GB	$1.30 768 GB/s	$2.25 444.4 TOPs	$998	75
NVIDIA A100 PCIe 80GB	$108.97 156 TFLOPs	$54.48 312 TFLOPs	$39.35 432 Cores	$212.49 80 GB	$8.79 1935 GB/s	$27.24 624 TOPs	$16,999	9
NVIDIA Tesla P100 16GB	$18.77 10.6 TFLOPs	$9.39 21.2 TFLOPs	$∞ n/a	$12.44 16 GB	$0.27 732 GB/s	$∞ n/a	$199	84
NVIDIA RTX 4090 24GB	$10.01 82.6 TFLOPs	$2.50 330.3 TFLOPs	$1.62 512 Cores	$34.46 24 GB	$0.82 1008 GB/s	$1.25 660.6 TOPs	$827	90
NVIDIA Tesla V100 32GB	$71.36 14 TFLOPs	$35.68 28 TFLOPs	$1.56 640 Cores	$31.22 32 GB	$1.11 900 GB/s	$17.84 56 TOPs	$999	41
NVIDIA H100 PCIe 80GB	$29.10 756 TFLOPs	$14.54 1513 TFLOPs	$48.25 456 Cores	$275.00 80 GB	$10.79 2039 GB/s	$7.27 3026 TOPs	$22,000	14
AMD Radeon RX 7900 XTX 24GB	$12.30 61 TFLOPs	$6.10 123 TFLOPs	$3.91 192 Cores	$31.25 24 GB	$0.78 960 GB/s	$6.10 123 TOPs	$750	55
NVIDIA L40S 48GB	$8.19 183 TFLOPs	$4.14 362 TFLOPs	$2.64 568 Cores	$31.23 48 GB	$1.73 864 GB/s	$1.02 1466 TOPs	$1,499	30
NVIDIA Tesla V100 16GB	$45.71 14 TFLOPs	$22.86 28 TFLOPs	$1.00 640 Cores	$40.00 16 GB	$0.71 900 GB/s	$11.43 56 TOPs	$640	42
AMD Radeon RX 7700 XT 12GB	$12.14 35 TFLOPs	$6.07 70 TFLOPs	$3.94 108 Cores	$35.42 12 GB	$0.98 432 GB/s	$∞ n/a	$425	31
AMD Radeon RX 7800 XT 16GB	$14.19 37 TFLOPs	$7.09 74 TFLOPs	$4.38 120 Cores	$32.81 16 GB	$0.84 624 GB/s	$∞ n/a	$525	43
AMD Radeon RX 7600 XT 16GB	$14.77 22.57 TFLOPs	$7.39 45.14 TFLOPs	$5.21 64 Cores	$20.84 16 GB	$1.16 288 GB/s	$∞ n/a	$333	17