GPUs Ranked by Cost per FP16 TFLOPs

Something missing? Let us know and we'll add it if we can.

GPU	$ / FP32 TFLOPs	$ / FP16 TFLOPs	$ / Tensor Core Count	$ / Memory Capacity (GB)	$ / Memory Bandwidth (GB/s)	$ / Int8 TOPs	Minimum Price	Available for Sale
NVIDIA T4 16GB	$67.90 8.1 TFLOPs	$8.46 65 TFLOPs	$1.72 320 Cores	$34.37 16 GB	$1.72 320 GB/s	$4.23 130 TOPs	$550	97
NVIDIA A30 24GB	$15.15 165 TFLOPs	$15.15 165 TFLOPs	$11.16 224 Cores	$104.17 24 GB	$2.68 933.3 GB/s	$7.58 330 TOPs	$2,500	35
NVIDIA A40 48GB	$177.40 37.4 TFLOPs	$177.40 37.4 TFLOPs	$19.75 336 Cores	$138.23 48 GB	$9.53 696 GB/s	$22.17 299.3 TOPs	$6,635	22
NVIDIA A10 24GB	$54.78 31.2 TFLOPs	$13.67 125 TFLOPs	$5.93 288 Cores	$71.21 24 GB	$2.85 600 GB/s	$6.84 250 TOPs	$1,709	66
NVIDIA L40 48GB	$53.81 90.5 TFLOPs	$26.90 181.05 TFLOPs	$8.57 568 Cores	$101.46 48 GB	$5.64 864 GB/s	$13.45 362 TOPs	$4,870	32
AMD Radeon RX 7900 XT 20GB	$13.94 52 TFLOPs	$7.04 103 TFLOPs	$4.32 168 Cores	$36.25 20 GB	$0.91 800 GB/s	$7.04 103 TOPs	$725	78
NVIDIA L4 24GB	$16.66 120 TFLOPs	$8.26 242 TFLOPs	$8.33 240 Cores	$83.32 24 GB	$6.67 300 GB/s	$4.12 485 TOPs	$2,000	37
NVIDIA RTX A5000 24GB	$49.41 27.77 TFLOPs	$49.41 27.77 TFLOPs	$5.36 256 Cores	$57.17 24 GB	$1.79 768 GB/s	$3.09 444.4 TOPs	$1,372	62
NVIDIA A100 PCIe 80GB	$123.74 156 TFLOPs	$61.87 312 TFLOPs	$44.69 432 Cores	$241.30 80 GB	$9.98 1935 GB/s	$30.94 624 TOPs	$19,304	15
NVIDIA Tesla P100 16GB	$18.87 10.6 TFLOPs	$9.43 21.2 TFLOPs	$∞ n/a	$12.50 16 GB	$0.27 732 GB/s	$∞ n/a	$200	100
NVIDIA Geforce RTX 4090 24GB	$27.85 82.6 TFLOPs	$3.48 660.6 TFLOPs	$4.49 512 Cores	$95.83 24 GB	$2.28 1008 GB/s	$1.74 1321.2 TOPs	$2,300	99
NVIDIA Tesla V100 32GB	$131.79 14 TFLOPs	$65.89 28 TFLOPs	$2.88 640 Cores	$57.66 32 GB	$2.05 900 GB/s	$32.95 56 TOPs	$1,845	36
NVIDIA H100 PCIe 80GB	$36.72 756 TFLOPs	$18.35 1513 TFLOPs	$60.87 456 Cores	$346.97 80 GB	$13.61 2039 GB/s	$9.17 3026 TOPs	$27,757	16
AMD Radeon RX 7900 XTX 24GB	$14.75 61 TFLOPs	$7.32 123 TFLOPs	$4.69 192 Cores	$37.50 24 GB	$0.94 960 GB/s	$7.32 123 TOPs	$900	90
NVIDIA L40S 48GB	$44.72 183 TFLOPs	$22.60 362 TFLOPs	$14.41 568 Cores	$170.48 48 GB	$9.47 864 GB/s	$5.58 1466 TOPs	$8,183	26
NVIDIA Tesla V100 16GB	$42.86 14 TFLOPs	$21.43 28 TFLOPs	$0.94 640 Cores	$37.50 16 GB	$0.67 900 GB/s	$10.71 56 TOPs	$600	49
AMD Radeon RX 7700 XT 12GB	$16.38 35 TFLOPs	$8.19 70 TFLOPs	$5.31 108 Cores	$47.77 12 GB	$1.33 432 GB/s	$∞ n/a	$573	40
AMD Radeon RX 7800 XT 16GB	$16.16 37 TFLOPs	$8.08 74 TFLOPs	$4.98 120 Cores	$37.38 16 GB	$0.96 624 GB/s	$∞ n/a	$598	55
AMD Radeon RX 7600 XT 16GB	$19.49 22.57 TFLOPs	$9.75 45.14 TFLOPs	$6.87 64 Cores	$27.50 16 GB	$1.53 288 GB/s	$∞ n/a	$440	7
NVIDIA GeForce RTX 5080 16GB	$12.39 112.6 TFLOPs	$3.10 450.2 TFLOPs	$4.15 336 Cores	$87.19 16 GB	$1.45 960 GB/s	$1.55 900.4 TOPs	$1,395	100
NVIDIA GeForce RTX 5090 32GB	$16.59 209.5 TFLOPs	$4.15 838 TFLOPs	$5.11 680 Cores	$108.59 32 GB	$1.94 1792 GB/s	$2.07 1676 TOPs	$3,475	57
NVIDIA GeForce RTX 5070 Ti 16GB	$9.32 112.6 TFLOPs	$2.33 450.2 TFLOPs	$3.12 336 Cores	$65.62 16 GB	$1.09 960 GB/s	$1.17 900.4 TOPs	$1,050	84
NVIDIA Geforce RTX 4070 12GB	$9.79 58.2 TFLOPs	$2.44 233.2 TFLOPs	$3.10 184 Cores	$47.50 12 GB	$1.13 504 GB/s	$1.22 466.4 TOPs	$570	64
NVIDIA Geforce RTX 4070 Ti 12GB	$8.73 80.2 TFLOPs	$2.18 320.8 TFLOPs	$2.92 240 Cores	$58.33 12 GB	$1.39 504 GB/s	$1.09 641.4 TOPs	$700	42
NVIDIA Geforce RTX 4080 16GB	$9.55 97.4 TFLOPs	$2.33 398.8 TFLOPs	$3.06 304 Cores	$58.12 16 GB	$1.30 716.8 GB/s	$1.19 779.82 TOPs	$930	78