GPUs Ranked by Cost per FP32 TFLOPs

Something missing? Let us know and we'll add it if we can.

GPU	$ / FP32 TFLOPs	$ / FP16 TFLOPs	$ / Tensor Core Count	$ / Memory Capacity (GB)	$ / Memory Bandwidth (GB/s)	$ / Int8 TOPs	Minimum Price	Available for Sale
NVIDIA T4 16GB	$83.33 8.1 TFLOPs	$10.38 65 TFLOPs	$2.11 320 Cores	$42.19 16 GB	$2.11 320 GB/s	$5.19 130 TOPs	$675	79
NVIDIA A30 24GB	$13.94 165 TFLOPs	$13.94 165 TFLOPs	$10.27 224 Cores	$95.83 24 GB	$2.46 933.3 GB/s	$6.97 330 TOPs	$2,300	33
NVIDIA A40 48GB	$147.06 37.4 TFLOPs	$147.06 37.4 TFLOPs	$16.37 336 Cores	$114.58 48 GB	$7.90 696 GB/s	$18.38 299.3 TOPs	$5,500	31
NVIDIA A10 24GB	$41.63 31.2 TFLOPs	$10.39 125 TFLOPs	$4.51 288 Cores	$54.13 24 GB	$2.17 600 GB/s	$5.20 250 TOPs	$1,299	65
NVIDIA L40 48GB	$62.43 90.5 TFLOPs	$31.21 181.05 TFLOPs	$9.95 568 Cores	$117.71 48 GB	$6.54 864 GB/s	$15.61 362 TOPs	$5,650	27
AMD Radeon RX 7900 XT 20GB	$11.25 52 TFLOPs	$5.68 103 TFLOPs	$3.48 168 Cores	$29.25 20 GB	$0.73 800 GB/s	$5.68 103 TOPs	$585	82
NVIDIA L4 24GB	$17.27 120 TFLOPs	$8.56 242 TFLOPs	$8.63 240 Cores	$86.33 24 GB	$6.91 300 GB/s	$4.27 485 TOPs	$2,072	47
NVIDIA RTX A5000 24GB	$48.61 27.77 TFLOPs	$48.61 27.77 TFLOPs	$5.27 256 Cores	$56.25 24 GB	$1.76 768 GB/s	$3.04 444.4 TOPs	$1,350	87
NVIDIA A100 PCIe 80GB	$76.92 156 TFLOPs	$38.46 312 TFLOPs	$27.78 432 Cores	$149.99 80 GB	$6.20 1935 GB/s	$19.23 624 TOPs	$11,999	11
NVIDIA Tesla P100 16GB	$13.96 10.6 TFLOPs	$6.98 21.2 TFLOPs	$∞ n/a	$9.25 16 GB	$0.20 732 GB/s	$∞ n/a	$148	100
NVIDIA Geforce RTX 4090 24GB	$26.03 82.6 TFLOPs	$3.25 660.6 TFLOPs	$4.20 512 Cores	$89.58 24 GB	$2.13 1008 GB/s	$1.63 1321.2 TOPs	$2,150	94
NVIDIA Tesla V100 32GB	$114.29 14 TFLOPs	$57.14 28 TFLOPs	$2.50 640 Cores	$50.00 32 GB	$1.78 900 GB/s	$28.57 56 TOPs	$1,600	34
NVIDIA H100 PCIe 80GB	$30.42 756 TFLOPs	$15.20 1513 TFLOPs	$50.44 456 Cores	$287.49 80 GB	$11.28 2039 GB/s	$7.60 3026 TOPs	$22,999	8
AMD Radeon RX 7900 XTX 24GB	$12.46 61 TFLOPs	$6.18 123 TFLOPs	$3.96 192 Cores	$31.67 24 GB	$0.79 960 GB/s	$6.18 123 TOPs	$760	98
NVIDIA L40S 48GB	$44.72 183 TFLOPs	$22.60 362 TFLOPs	$14.41 568 Cores	$170.48 48 GB	$9.47 864 GB/s	$5.58 1466 TOPs	$8,183	24
NVIDIA Tesla V100 16GB	$32.86 14 TFLOPs	$16.43 28 TFLOPs	$0.72 640 Cores	$28.75 16 GB	$0.51 900 GB/s	$8.21 56 TOPs	$460	57
AMD Radeon RX 7700 XT 12GB	$12.00 35 TFLOPs	$6.00 70 TFLOPs	$3.89 108 Cores	$35.00 12 GB	$0.97 432 GB/s	$∞ n/a	$420	53
AMD Radeon RX 7800 XT 16GB	$13.51 37 TFLOPs	$6.76 74 TFLOPs	$4.17 120 Cores	$31.25 16 GB	$0.80 624 GB/s	$∞ n/a	$500	62
AMD Radeon RX 7600 XT 16GB	$13.07 22.57 TFLOPs	$6.54 45.14 TFLOPs	$4.61 64 Cores	$18.44 16 GB	$1.02 288 GB/s	$∞ n/a	$295	9
NVIDIA GeForce RTX 5080 16GB	$10.71 112.6 TFLOPs	$2.68 450.2 TFLOPs	$3.59 336 Cores	$75.40 16 GB	$1.26 960 GB/s	$1.34 900.4 TOPs	$1,206	98
NVIDIA GeForce RTX 5090 32GB	$12.51 209.5 TFLOPs	$3.13 838 TFLOPs	$3.85 680 Cores	$81.90 32 GB	$1.46 1792 GB/s	$1.56 1676 TOPs	$2,621	99
NVIDIA GeForce RTX 5070 Ti 16GB	$7.46 112.6 TFLOPs	$1.87 450.2 TFLOPs	$2.50 336 Cores	$52.50 16 GB	$0.87 960 GB/s	$0.93 900.4 TOPs	$840	95
NVIDIA Geforce RTX 4070 12GB	$8.59 58.2 TFLOPs	$2.14 233.2 TFLOPs	$2.72 184 Cores	$41.67 12 GB	$0.99 504 GB/s	$1.07 466.4 TOPs	$500	97
NVIDIA Geforce RTX 4070 Ti 12GB	$11.22 80.2 TFLOPs	$2.81 320.8 TFLOPs	$3.75 240 Cores	$75.00 12 GB	$1.79 504 GB/s	$1.40 641.4 TOPs	$900	22
NVIDIA Geforce RTX 4080 16GB	$9.37 97.4 TFLOPs	$2.29 398.8 TFLOPs	$3.00 304 Cores	$57.02 16 GB	$1.27 716.8 GB/s	$1.17 779.82 TOPs	$912	95