GPUs Ranked by Cost per FP32 TFLOPs

Something missing? Let us know and we'll add it if we can.

GPU	$ / FP32 TFLOPs	$ / FP16 TFLOPs	$ / Tensor Core Count	$ / Memory Capacity (GB)	$ / Memory Bandwidth (GB/s)	$ / Int8 TOPs	Minimum Price	Available for Sale
NVIDIA T4 16GB	$61.60 8.1 TFLOPs	$7.68 65 TFLOPs	$1.56 320 Cores	$31.19 16 GB	$1.56 320 GB/s	$3.84 130 TOPs	$499	77
NVIDIA A30 24GB	$20.91 165 TFLOPs	$20.91 165 TFLOPs	$15.40 224 Cores	$143.75 24 GB	$3.70 933.3 GB/s	$10.45 330 TOPs	$3,450	35
NVIDIA A40 48GB	$140.37 37.4 TFLOPs	$140.37 37.4 TFLOPs	$15.63 336 Cores	$109.38 48 GB	$7.54 696 GB/s	$17.54 299.3 TOPs	$5,250	27
NVIDIA A10 24GB	$48.08 31.2 TFLOPs	$12.00 125 TFLOPs	$5.21 288 Cores	$62.50 24 GB	$2.50 600 GB/s	$6.00 250 TOPs	$1,500	62
NVIDIA L40 48GB	$60.77 90.5 TFLOPs	$30.38 181.05 TFLOPs	$9.68 568 Cores	$114.58 48 GB	$6.37 864 GB/s	$15.19 362 TOPs	$5,500	28
AMD Radeon RX 7900 XT 20GB	$11.35 52 TFLOPs	$5.73 103 TFLOPs	$3.51 168 Cores	$29.50 20 GB	$0.74 800 GB/s	$5.73 103 TOPs	$590	100
NVIDIA L4 24GB	$15.83 120 TFLOPs	$7.85 242 TFLOPs	$7.91 240 Cores	$79.13 24 GB	$6.33 300 GB/s	$3.92 485 TOPs	$1,899	54
NVIDIA RTX A5000 24GB	$50.41 27.77 TFLOPs	$50.41 27.77 TFLOPs	$5.47 256 Cores	$58.33 24 GB	$1.82 768 GB/s	$3.15 444.4 TOPs	$1,400	83
NVIDIA A100 PCIe 80GB	$73.72 156 TFLOPs	$36.86 312 TFLOPs	$26.62 432 Cores	$143.75 80 GB	$5.94 1935 GB/s	$18.43 624 TOPs	$11,500	11
NVIDIA Tesla P100 16GB	$13.02 10.6 TFLOPs	$6.51 21.2 TFLOPs	$∞ n/a	$8.62 16 GB	$0.19 732 GB/s	$∞ n/a	$138	100
NVIDIA Geforce RTX 4090 24GB	$26.63 82.6 TFLOPs	$3.33 660.6 TFLOPs	$4.30 512 Cores	$91.67 24 GB	$2.18 1008 GB/s	$1.67 1321.2 TOPs	$2,200	93
NVIDIA Tesla V100 32GB	$99.14 14 TFLOPs	$49.57 28 TFLOPs	$2.17 640 Cores	$43.38 32 GB	$1.54 900 GB/s	$24.79 56 TOPs	$1,388	41
NVIDIA H100 PCIe 80GB	$36.97 756 TFLOPs	$18.47 1513 TFLOPs	$61.29 456 Cores	$349.34 80 GB	$13.71 2039 GB/s	$9.24 3026 TOPs	$27,947	9
AMD Radeon RX 7900 XTX 24GB	$12.30 61 TFLOPs	$6.10 123 TFLOPs	$3.91 192 Cores	$31.25 24 GB	$0.78 960 GB/s	$6.10 123 TOPs	$750	100
NVIDIA L40S 48GB	$44.72 183 TFLOPs	$22.60 362 TFLOPs	$14.41 568 Cores	$170.48 48 GB	$9.47 864 GB/s	$5.58 1466 TOPs	$8,183	26
NVIDIA Tesla V100 16GB	$32.14 14 TFLOPs	$16.07 28 TFLOPs	$0.70 640 Cores	$28.12 16 GB	$0.50 900 GB/s	$8.04 56 TOPs	$450	60
AMD Radeon RX 7700 XT 12GB	$10.86 35 TFLOPs	$5.43 70 TFLOPs	$3.52 108 Cores	$31.67 12 GB	$0.88 432 GB/s	$∞ n/a	$380	59
AMD Radeon RX 7800 XT 16GB	$12.84 37 TFLOPs	$6.42 74 TFLOPs	$3.96 120 Cores	$29.69 16 GB	$0.76 624 GB/s	$∞ n/a	$475	78
AMD Radeon RX 7600 XT 16GB	$15.57 22.57 TFLOPs	$7.79 45.14 TFLOPs	$5.49 64 Cores	$21.97 16 GB	$1.22 288 GB/s	$∞ n/a	$351	15
NVIDIA GeForce RTX 5080 16GB	$10.48 112.6 TFLOPs	$2.62 450.2 TFLOPs	$3.51 336 Cores	$73.75 16 GB	$1.23 960 GB/s	$1.31 900.4 TOPs	$1,180	97
NVIDIA GeForce RTX 5090 32GB	$12.41 209.5 TFLOPs	$3.10 838 TFLOPs	$3.82 680 Cores	$81.22 32 GB	$1.45 1792 GB/s	$1.55 1676 TOPs	$2,599	99
NVIDIA GeForce RTX 5070 Ti 16GB	$7.41 112.6 TFLOPs	$1.85 450.2 TFLOPs	$2.48 336 Cores	$52.16 16 GB	$0.87 960 GB/s	$0.93 900.4 TOPs	$835	99
NVIDIA Geforce RTX 4070 12GB	$8.33 58.2 TFLOPs	$2.08 233.2 TFLOPs	$2.64 184 Cores	$40.41 12 GB	$0.96 504 GB/s	$1.04 466.4 TOPs	$485	96
NVIDIA Geforce RTX 4070 Ti 12GB	$8.47 80.2 TFLOPs	$2.12 320.8 TFLOPs	$2.83 240 Cores	$56.58 12 GB	$1.35 504 GB/s	$1.06 641.4 TOPs	$679	21
NVIDIA Geforce RTX 4080 16GB	$9.24 97.4 TFLOPs	$2.26 398.8 TFLOPs	$2.96 304 Cores	$56.25 16 GB	$1.26 716.8 GB/s	$1.15 779.82 TOPs	$900	94