GPUs Ranked by Cost per FP16 TFLOPs

Something missing? Let us know and we'll add it if we can.

GPU	$ / FP32 TFLOPs	$ / FP16 TFLOPs	$ / Tensor Core Count	$ / Memory Capacity (GB)	$ / Memory Bandwidth (GB/s)	$ / Int8 TOPs	Minimum Price	Available for Sale
NVIDIA T4 16GB	$64.20 8.1 TFLOPs	$8.00 65 TFLOPs	$1.63 320 Cores	$32.50 16 GB	$1.63 320 GB/s	$4.00 130 TOPs	$520	81
NVIDIA A30 24GB	$14.55 165 TFLOPs	$14.55 165 TFLOPs	$10.71 224 Cores	$100.00 24 GB	$2.57 933.3 GB/s	$7.27 330 TOPs	$2,400	34
NVIDIA A40 48GB	$160.43 37.4 TFLOPs	$160.43 37.4 TFLOPs	$17.86 336 Cores	$125.00 48 GB	$8.62 696 GB/s	$20.05 299.3 TOPs	$6,000	27
NVIDIA A10 24GB	$41.63 31.2 TFLOPs	$10.39 125 TFLOPs	$4.51 288 Cores	$54.13 24 GB	$2.17 600 GB/s	$5.20 250 TOPs	$1,299	67
NVIDIA L40 48GB	$60.50 90.5 TFLOPs	$30.24 181.05 TFLOPs	$9.64 568 Cores	$114.06 48 GB	$6.34 864 GB/s	$15.12 362 TOPs	$5,475	27
AMD Radeon RX 7900 XT 20GB	$9.85 52 TFLOPs	$4.97 103 TFLOPs	$3.05 168 Cores	$25.60 20 GB	$0.64 800 GB/s	$4.97 103 TOPs	$512	70
NVIDIA L4 24GB	$17.29 120 TFLOPs	$8.57 242 TFLOPs	$8.65 240 Cores	$86.46 24 GB	$6.92 300 GB/s	$4.28 485 TOPs	$2,075	46
NVIDIA RTX A5000 24GB	$46.78 27.77 TFLOPs	$46.78 27.77 TFLOPs	$5.07 256 Cores	$54.13 24 GB	$1.69 768 GB/s	$2.92 444.4 TOPs	$1,299	72
NVIDIA A100 PCIe 80GB	$76.92 156 TFLOPs	$38.46 312 TFLOPs	$27.78 432 Cores	$149.99 80 GB	$6.20 1935 GB/s	$19.23 624 TOPs	$11,999	9
NVIDIA Tesla P100 16GB	$14.15 10.6 TFLOPs	$7.07 21.2 TFLOPs	$∞ n/a	$9.37 16 GB	$0.20 732 GB/s	$∞ n/a	$150	100
NVIDIA Geforce RTX 4090 24GB	$25.42 82.6 TFLOPs	$3.18 660.6 TFLOPs	$4.10 512 Cores	$87.50 24 GB	$2.08 1008 GB/s	$1.59 1321.2 TOPs	$2,100	100
NVIDIA Tesla V100 32GB	$114.29 14 TFLOPs	$57.14 28 TFLOPs	$2.50 640 Cores	$50.00 32 GB	$1.78 900 GB/s	$28.57 56 TOPs	$1,600	34
NVIDIA H100 PCIe 80GB	$37.12 756 TFLOPs	$18.55 1513 TFLOPs	$61.55 456 Cores	$350.82 80 GB	$13.76 2039 GB/s	$9.27 3026 TOPs	$28,066	7
AMD Radeon RX 7900 XTX 24GB	$13.11 61 TFLOPs	$6.50 123 TFLOPs	$4.17 192 Cores	$33.33 24 GB	$0.83 960 GB/s	$6.50 123 TOPs	$800	100
NVIDIA L40S 48GB	$44.72 183 TFLOPs	$22.60 362 TFLOPs	$14.41 568 Cores	$170.48 48 GB	$9.47 864 GB/s	$5.58 1466 TOPs	$8,183	24
NVIDIA Tesla V100 16GB	$32.14 14 TFLOPs	$16.07 28 TFLOPs	$0.70 640 Cores	$28.12 16 GB	$0.50 900 GB/s	$8.04 56 TOPs	$450	57
AMD Radeon RX 7700 XT 12GB	$11.43 35 TFLOPs	$5.71 70 TFLOPs	$3.70 108 Cores	$33.33 12 GB	$0.93 432 GB/s	$∞ n/a	$400	54
AMD Radeon RX 7800 XT 16GB	$13.95 37 TFLOPs	$6.97 74 TFLOPs	$4.30 120 Cores	$32.25 16 GB	$0.83 624 GB/s	$∞ n/a	$516	66
AMD Radeon RX 7600 XT 16GB	$14.18 22.57 TFLOPs	$7.09 45.14 TFLOPs	$5.00 64 Cores	$20.00 16 GB	$1.11 288 GB/s	$∞ n/a	$320	10
NVIDIA GeForce RTX 5080 16GB	$10.66 112.6 TFLOPs	$2.67 450.2 TFLOPs	$3.57 336 Cores	$75.00 16 GB	$1.25 960 GB/s	$1.33 900.4 TOPs	$1,200	99
NVIDIA GeForce RTX 5090 32GB	$12.49 209.5 TFLOPs	$3.12 838 TFLOPs	$3.85 680 Cores	$81.79 32 GB	$1.46 1792 GB/s	$1.56 1676 TOPs	$2,617	99
NVIDIA GeForce RTX 5070 Ti 16GB	$7.54 112.6 TFLOPs	$1.89 450.2 TFLOPs	$2.53 336 Cores	$53.06 16 GB	$0.88 960 GB/s	$0.94 900.4 TOPs	$849	100
NVIDIA Geforce RTX 4070 12GB	$8.33 58.2 TFLOPs	$2.08 233.2 TFLOPs	$2.64 184 Cores	$40.42 12 GB	$0.96 504 GB/s	$1.04 466.4 TOPs	$485	97
NVIDIA Geforce RTX 4070 Ti 12GB	$7.85 80.2 TFLOPs	$1.96 320.8 TFLOPs	$2.62 240 Cores	$52.50 12 GB	$1.25 504 GB/s	$0.98 641.4 TOPs	$630	25
NVIDIA Geforce RTX 4080 16GB	$9.45 97.4 TFLOPs	$2.31 398.8 TFLOPs	$3.03 304 Cores	$57.50 16 GB	$1.28 716.8 GB/s	$1.18 779.82 TOPs	$920	95