GPUs Ranked by Cost per FP32 TFLOPs

Something missing? Let us know and we'll add it if we can.

GPU	$ / FP32 TFLOPs	$ / FP16 TFLOPs	$ / Tensor Core Count	$ / Memory Capacity (GB)	$ / Memory Bandwidth (GB/s)	$ / Int8 TOPs	Minimum Price	Available for Sale
AMD Radeon RX 7600 XT 16GB	$12.85 22.57 TFLOPs	$6.42 45.14 TFLOPs	$4.53 64 Cores	$18.13 16 GB	$1.01 288 GB/s	$∞ n/a	$290	16
AMD Radeon RX 7700 XT 12GB	$10.14 35 TFLOPs	$5.07 70 TFLOPs	$3.29 108 Cores	$29.58 12 GB	$0.82 432 GB/s	$∞ n/a	$355	54
AMD Radeon RX 7800 XT 16GB	$10.92 37 TFLOPs	$5.46 74 TFLOPs	$3.37 120 Cores	$25.25 16 GB	$0.65 624 GB/s	$∞ n/a	$404	70
AMD Radeon RX 7900 XT 20GB	$9.62 52 TFLOPs	$4.85 103 TFLOPs	$2.98 168 Cores	$25.00 20 GB	$0.63 800 GB/s	$4.85 103 TOPs	$500	94
AMD Radeon RX 7900 XTX 24GB	$1.89 61 TFLOPs	$0.93 123 TFLOPs	$0.60 192 Cores	$4.79 24 GB	$0.12 960 GB/s	$0.93 123 TOPs	$115	49
NVIDIA A10 24GB	$39.42 31.2 TFLOPs	$9.84 125 TFLOPs	$4.27 288 Cores	$51.25 24 GB	$2.05 600 GB/s	$4.92 250 TOPs	$1,230	71
NVIDIA A100 PCIe 80GB	$60.87 156 TFLOPs	$30.44 312 TFLOPs	$21.98 432 Cores	$118.70 80 GB	$4.91 1935 GB/s	$15.22 624 TOPs	$9,496	15
NVIDIA A30 24GB	$17.88 165 TFLOPs	$17.88 165 TFLOPs	$13.17 224 Cores	$122.92 24 GB	$3.16 933.3 GB/s	$8.94 330 TOPs	$2,950	49
NVIDIA A40 48GB	$101.58 37.4 TFLOPs	$101.58 37.4 TFLOPs	$11.31 336 Cores	$79.15 48 GB	$5.46 696 GB/s	$12.69 299.3 TOPs	$3,799	34
NVIDIA Geforce RTX 4070 Ti 12GB	$4.92 80.2 TFLOPs	$1.23 320.8 TFLOPs	$1.64 240 Cores	$32.88 12 GB	$0.78 504 GB/s	$0.62 641.4 TOPs	$395	50
NVIDIA Geforce RTX 4070 12GB	$5.58 58.2 TFLOPs	$1.39 233.2 TFLOPs	$1.77 184 Cores	$27.08 12 GB	$0.64 504 GB/s	$0.70 466.4 TOPs	$325	80
NVIDIA Geforce RTX 4080 16GB	$7.80 97.4 TFLOPs	$1.91 398.8 TFLOPs	$2.50 304 Cores	$47.50 16 GB	$1.06 716.8 GB/s	$0.97 779.82 TOPs	$760	100
NVIDIA Geforce RTX 4090 24GB	$25.42 82.6 TFLOPs	$3.18 660.6 TFLOPs	$4.10 512 Cores	$87.50 24 GB	$2.08 1008 GB/s	$1.59 1321.2 TOPs	$2,100	94
NVIDIA GeForce RTX 5070 Ti 16GB	$6.84 112.6 TFLOPs	$1.71 450.2 TFLOPs	$2.29 336 Cores	$48.12 16 GB	$0.80 960 GB/s	$0.86 900.4 TOPs	$770	95
NVIDIA GeForce RTX 5080 16GB	$8.44 112.6 TFLOPs	$2.11 450.2 TFLOPs	$2.83 336 Cores	$59.38 16 GB	$0.99 960 GB/s	$1.06 900.4 TOPs	$950	99
NVIDIA H100 PCIe 80GB	$36.26 756 TFLOPs	$18.12 1513 TFLOPs	$60.12 456 Cores	$342.69 80 GB	$13.45 2039 GB/s	$9.06 3026 TOPs	$27,415	12
NVIDIA L4 24GB	$15.83 120 TFLOPs	$7.85 242 TFLOPs	$7.91 240 Cores	$79.13 24 GB	$6.33 300 GB/s	$3.92 485 TOPs	$1,899	52
NVIDIA L40 48GB	$66.29 90.5 TFLOPs	$33.13 181.05 TFLOPs	$10.56 568 Cores	$124.98 48 GB	$6.94 864 GB/s	$16.57 362 TOPs	$5,999	27
NVIDIA L40S 48GB	$34.97 183 TFLOPs	$17.68 362 TFLOPs	$11.27 568 Cores	$133.33 48 GB	$7.41 864 GB/s	$4.37 1466 TOPs	$6,400	37
NVIDIA RTX A5000 24GB	$51.85 27.77 TFLOPs	$51.85 27.77 TFLOPs	$5.62 256 Cores	$60.00 24 GB	$1.87 768 GB/s	$3.24 444.4 TOPs	$1,440	77
NVIDIA T4 16GB	$9.88 8.1 TFLOPs	$1.23 65 TFLOPs	$0.25 320 Cores	$5.00 16 GB	$0.25 320 GB/s	$0.62 130 TOPs	$80	94
NVIDIA Tesla P100 16GB	$9.24 10.6 TFLOPs	$4.62 21.2 TFLOPs	$∞ n/a	$6.12 16 GB	$0.13 732 GB/s	$∞ n/a	$98	100
NVIDIA Tesla V100 16GB	$20.00 14 TFLOPs	$10.00 28 TFLOPs	$0.44 640 Cores	$17.50 16 GB	$0.31 900 GB/s	$5.00 56 TOPs	$280	71
NVIDIA Tesla V100 32GB	$50.00 14 TFLOPs	$25.00 28 TFLOPs	$1.09 640 Cores	$21.87 32 GB	$0.78 900 GB/s	$12.50 56 TOPs	$700	55
NVIDIA GeForce RTX 5090 32GB	$11.93 209.5 TFLOPs	$2.98 838 TFLOPs	$3.68 680 Cores	$78.12 32 GB	$1.40 1792 GB/s	$1.49 1676 TOPs	$2,500	94