GPUs Ranked by Cost per FP32 TFLOPs

Something missing? Let us know and we'll add it if we can.

GPU	$ / FP32 TFLOPs	$ / FP16 TFLOPs	$ / Tensor Core Count	$ / Memory Capacity (GB)	$ / Memory Bandwidth (GB/s)	$ / Int8 TOPs	Minimum Price	Available for Sale
NVIDIA T4 16GB	$82.59 8.1 TFLOPs	$10.29 65 TFLOPs	$2.09 320 Cores	$41.81 16 GB	$2.09 320 GB/s	$5.15 130 TOPs	$669	83
NVIDIA A30 24GB	$14.55 165 TFLOPs	$14.55 165 TFLOPs	$10.71 224 Cores	$100.00 24 GB	$2.57 933.3 GB/s	$7.27 330 TOPs	$2,400	32
NVIDIA A40 48GB	$160.43 37.4 TFLOPs	$160.43 37.4 TFLOPs	$17.86 336 Cores	$125.00 48 GB	$8.62 696 GB/s	$20.05 299.3 TOPs	$6,000	27
NVIDIA A10 24GB	$40.06 31.2 TFLOPs	$10.00 125 TFLOPs	$4.34 288 Cores	$52.08 24 GB	$2.08 600 GB/s	$5.00 250 TOPs	$1,250	68
NVIDIA L40 48GB	$62.43 90.5 TFLOPs	$31.21 181.05 TFLOPs	$9.95 568 Cores	$117.71 48 GB	$6.54 864 GB/s	$15.61 362 TOPs	$5,650	54
AMD Radeon RX 7900 XT 20GB	$12.02 52 TFLOPs	$6.07 103 TFLOPs	$3.72 168 Cores	$31.25 20 GB	$0.78 800 GB/s	$6.07 103 TOPs	$625	83
NVIDIA L4 24GB	$13.33 120 TFLOPs	$6.61 242 TFLOPs	$6.67 240 Cores	$66.67 24 GB	$5.33 300 GB/s	$3.30 485 TOPs	$1,600	49
NVIDIA RTX A5000 24GB	$52.21 27.77 TFLOPs	$52.21 27.77 TFLOPs	$5.66 256 Cores	$60.42 24 GB	$1.89 768 GB/s	$3.26 444.4 TOPs	$1,450	81
NVIDIA A100 PCIe 80GB	$76.92 156 TFLOPs	$38.46 312 TFLOPs	$27.78 432 Cores	$149.99 80 GB	$6.20 1935 GB/s	$19.23 624 TOPs	$11,999	11
NVIDIA Tesla P100 16GB	$14.15 10.6 TFLOPs	$7.07 21.2 TFLOPs	$∞ n/a	$9.37 16 GB	$0.20 732 GB/s	$∞ n/a	$150	100
NVIDIA Geforce RTX 4090 24GB	$26.63 82.6 TFLOPs	$3.33 660.6 TFLOPs	$4.30 512 Cores	$91.67 24 GB	$2.18 1008 GB/s	$1.67 1321.2 TOPs	$2,200	99
NVIDIA Tesla V100 32GB	$92.86 14 TFLOPs	$46.43 28 TFLOPs	$2.03 640 Cores	$40.63 32 GB	$1.44 900 GB/s	$23.21 56 TOPs	$1,300	34
NVIDIA H100 PCIe 80GB	$31.74 756 TFLOPs	$15.86 1513 TFLOPs	$52.63 456 Cores	$299.99 80 GB	$11.77 2039 GB/s	$7.93 3026 TOPs	$23,999	8
AMD Radeon RX 7900 XTX 24GB	$13.11 61 TFLOPs	$6.50 123 TFLOPs	$4.17 192 Cores	$33.33 24 GB	$0.83 960 GB/s	$6.50 123 TOPs	$800	100
NVIDIA L40S 48GB	n/a 183 TFLOPs	n/a 362 TFLOPs	n/a 568 Cores	n/a 48 GB	n/a 864 GB/s	n/a 1466 TOPs	n/a	0
NVIDIA Tesla V100 16GB	$32.86 14 TFLOPs	$16.43 28 TFLOPs	$0.72 640 Cores	$28.75 16 GB	$0.51 900 GB/s	$8.21 56 TOPs	$460	55
AMD Radeon RX 7700 XT 12GB	$11.46 35 TFLOPs	$5.73 70 TFLOPs	$3.71 108 Cores	$33.42 12 GB	$0.93 432 GB/s	$∞ n/a	$401	53
AMD Radeon RX 7800 XT 16GB	$12.84 37 TFLOPs	$6.42 74 TFLOPs	$3.96 120 Cores	$29.69 16 GB	$0.76 624 GB/s	$∞ n/a	$475	64
AMD Radeon RX 7600 XT 16GB	$15.51 22.57 TFLOPs	$7.75 45.14 TFLOPs	$5.47 64 Cores	$21.87 16 GB	$1.22 288 GB/s	$∞ n/a	$350	8
NVIDIA GeForce RTX 5080 16GB	$11.10 112.6 TFLOPs	$2.78 450.2 TFLOPs	$3.72 336 Cores	$78.12 16 GB	$1.30 960 GB/s	$1.39 900.4 TOPs	$1,250	97
NVIDIA GeForce RTX 5090 32GB	$12.64 209.5 TFLOPs	$3.16 838 TFLOPs	$3.89 680 Cores	$82.72 32 GB	$1.48 1792 GB/s	$1.58 1676 TOPs	$2,647	98
NVIDIA GeForce RTX 5070 Ti 16GB	$7.54 112.6 TFLOPs	$1.89 450.2 TFLOPs	$2.53 336 Cores	$53.06 16 GB	$0.88 960 GB/s	$0.94 900.4 TOPs	$849	99
NVIDIA Geforce RTX 4070 12GB	$8.59 58.2 TFLOPs	$2.14 233.2 TFLOPs	$2.72 184 Cores	$41.67 12 GB	$0.99 504 GB/s	$1.07 466.4 TOPs	$500	95
NVIDIA Geforce RTX 4070 Ti 12GB	$8.65 80.2 TFLOPs	$2.16 320.8 TFLOPs	$2.89 240 Cores	$57.79 12 GB	$1.38 504 GB/s	$1.08 641.4 TOPs	$693	27
NVIDIA Geforce RTX 4080 16GB	$8.79 97.4 TFLOPs	$2.15 398.8 TFLOPs	$2.82 304 Cores	$53.52 16 GB	$1.19 716.8 GB/s	$1.10 779.82 TOPs	$856	98