GPUs Ranked by Cost per FP32 TFLOPs

Something missing? Let us know and we'll add it if we can.

GPU	$ / FP32 TFLOPs	$ / FP16 TFLOPs	$ / Tensor Core Count	$ / Memory Capacity (GB)	$ / Memory Bandwidth (GB/s)	$ / Int8 TOPs	Minimum Price	Available for Sale
AMD Radeon RX 7600 XT 16GB	$12.18 22.57 TFLOPs	$6.09 45.14 TFLOPs	$4.30 64 Cores	$17.19 16 GB	$0.95 288 GB/s	$∞ n/a	$275	13
AMD Radeon RX 7700 XT 12GB	$9.29 35 TFLOPs	$4.64 70 TFLOPs	$3.01 108 Cores	$27.08 12 GB	$0.75 432 GB/s	$∞ n/a	$325	44
AMD Radeon RX 7800 XT 16GB	$10.81 37 TFLOPs	$5.41 74 TFLOPs	$3.33 120 Cores	$25.00 16 GB	$0.64 624 GB/s	$∞ n/a	$400	53
AMD Radeon RX 7900 XT 20GB	$9.62 52 TFLOPs	$4.85 103 TFLOPs	$2.98 168 Cores	$25.00 20 GB	$0.63 800 GB/s	$4.85 103 TOPs	$500	85
AMD Radeon RX 7900 XTX 24GB	$1.89 61 TFLOPs	$0.93 123 TFLOPs	$0.60 192 Cores	$4.79 24 GB	$0.12 960 GB/s	$0.93 123 TOPs	$115	93
NVIDIA A10 24GB	$41.67 31.2 TFLOPs	$10.40 125 TFLOPs	$4.51 288 Cores	$54.17 24 GB	$2.17 600 GB/s	$5.20 250 TOPs	$1,300	70
NVIDIA A100 PCIe 80GB	$58.65 156 TFLOPs	$29.33 312 TFLOPs	$21.18 432 Cores	$114.38 80 GB	$4.73 1935 GB/s	$14.66 624 TOPs	$9,150	18
NVIDIA A30 24GB	$17.88 165 TFLOPs	$17.88 165 TFLOPs	$13.17 224 Cores	$122.92 24 GB	$3.16 933.3 GB/s	$8.94 330 TOPs	$2,950	50
NVIDIA A40 48GB	$125.67 37.4 TFLOPs	$125.67 37.4 TFLOPs	$13.99 336 Cores	$97.92 48 GB	$6.75 696 GB/s	$15.70 299.3 TOPs	$4,700	32
NVIDIA Geforce RTX 4070 Ti 12GB	$6.23 80.2 TFLOPs	$1.56 320.8 TFLOPs	$2.08 240 Cores	$41.66 12 GB	$0.99 504 GB/s	$0.78 641.4 TOPs	$500	39
NVIDIA Geforce RTX 4070 12GB	$6.79 58.2 TFLOPs	$1.69 233.2 TFLOPs	$2.15 184 Cores	$32.92 12 GB	$0.78 504 GB/s	$0.85 466.4 TOPs	$395	78
NVIDIA Geforce RTX 4080 16GB	$7.32 97.4 TFLOPs	$1.79 398.8 TFLOPs	$2.35 304 Cores	$44.57 16 GB	$0.99 716.8 GB/s	$0.91 779.82 TOPs	$713	99
NVIDIA Geforce RTX 4090 24GB	$27.36 82.6 TFLOPs	$3.42 660.6 TFLOPs	$4.41 512 Cores	$94.17 24 GB	$2.24 1008 GB/s	$1.71 1321.2 TOPs	$2,260	90
NVIDIA GeForce RTX 5070 Ti 16GB	$6.66 112.6 TFLOPs	$1.67 450.2 TFLOPs	$2.23 336 Cores	$46.88 16 GB	$0.78 960 GB/s	$0.83 900.4 TOPs	$750	93
NVIDIA GeForce RTX 5080 16GB	$8.44 112.6 TFLOPs	$2.11 450.2 TFLOPs	$2.83 336 Cores	$59.37 16 GB	$0.99 960 GB/s	$1.06 900.4 TOPs	$950	100
NVIDIA H100 PCIe 80GB	$36.34 756 TFLOPs	$18.16 1513 TFLOPs	$60.25 456 Cores	$343.45 80 GB	$13.48 2039 GB/s	$9.08 3026 TOPs	$27,476	13
NVIDIA L4 24GB	$18.17 120 TFLOPs	$9.01 242 TFLOPs	$9.08 240 Cores	$90.83 24 GB	$7.27 300 GB/s	$4.49 485 TOPs	$2,180	51
NVIDIA L40 48GB	$71.82 90.5 TFLOPs	$35.90 181.05 TFLOPs	$11.44 568 Cores	$135.42 48 GB	$7.52 864 GB/s	$17.96 362 TOPs	$6,500	26
NVIDIA L40S 48GB	$39.89 183 TFLOPs	$20.16 362 TFLOPs	$12.85 568 Cores	$152.06 48 GB	$8.45 864 GB/s	$4.98 1466 TOPs	$7,299	42
NVIDIA RTX A5000 24GB	$53.98 27.77 TFLOPs	$53.98 27.77 TFLOPs	$5.86 256 Cores	$62.46 24 GB	$1.95 768 GB/s	$3.37 444.4 TOPs	$1,499	68
NVIDIA T4 16GB	$9.88 8.1 TFLOPs	$1.23 65 TFLOPs	$0.25 320 Cores	$5.00 16 GB	$0.25 320 GB/s	$0.62 130 TOPs	$80	92
NVIDIA Tesla P100 16GB	$7.55 10.6 TFLOPs	$3.77 21.2 TFLOPs	$∞ n/a	$5.00 16 GB	$0.11 732 GB/s	$∞ n/a	$80	98
NVIDIA Tesla V100 16GB	$12.50 14 TFLOPs	$6.25 28 TFLOPs	$0.27 640 Cores	$10.94 16 GB	$0.19 900 GB/s	$3.13 56 TOPs	$175	67
NVIDIA Tesla V100 32GB	$50.00 14 TFLOPs	$25.00 28 TFLOPs	$1.09 640 Cores	$21.87 32 GB	$0.78 900 GB/s	$12.50 56 TOPs	$700	63
NVIDIA GeForce RTX 5090 32GB	$11.69 209.5 TFLOPs	$2.92 838 TFLOPs	$3.60 680 Cores	$76.56 32 GB	$1.37 1792 GB/s	$1.46 1676 TOPs	$2,450	38