GPUs Ranked by Cost per FP16 TFLOPs

Something missing? Let us know and we'll add it if we can.

GPU	$ / FP32 TFLOPs	$ / FP16 TFLOPs	$ / Tensor Core Count	$ / Memory Capacity (GB)	$ / Memory Bandwidth (GB/s)	$ / Int8 TOPs	Minimum Price	Available for Sale
NVIDIA T4 16GB	$61.73 8.1 TFLOPs	$7.69 65 TFLOPs	$1.56 320 Cores	$31.25 16 GB	$1.56 320 GB/s	$3.85 130 TOPs	$500	90
NVIDIA A30 24GB	$16.97 165 TFLOPs	$16.97 165 TFLOPs	$12.50 224 Cores	$116.67 24 GB	$3.00 933.3 GB/s	$8.48 330 TOPs	$2,800	37
NVIDIA A40 48GB	$155.70 37.4 TFLOPs	$155.70 37.4 TFLOPs	$17.33 336 Cores	$121.32 48 GB	$8.37 696 GB/s	$19.46 299.3 TOPs	$5,823	25
NVIDIA A10 24GB	$54.78 31.2 TFLOPs	$13.67 125 TFLOPs	$5.93 288 Cores	$71.21 24 GB	$2.85 600 GB/s	$6.84 250 TOPs	$1,709	65
NVIDIA L40 48GB	$55.19 90.5 TFLOPs	$27.59 181.05 TFLOPs	$8.79 568 Cores	$104.06 48 GB	$5.78 864 GB/s	$13.80 362 TOPs	$4,995	59
AMD Radeon RX 7900 XT 20GB	$14.81 52 TFLOPs	$7.48 103 TFLOPs	$4.58 168 Cores	$38.50 20 GB	$0.96 800 GB/s	$7.48 103 TOPs	$770	66
NVIDIA L4 24GB	$16.25 120 TFLOPs	$8.06 242 TFLOPs	$8.13 240 Cores	$81.25 24 GB	$6.50 300 GB/s	$4.02 485 TOPs	$1,950	37
NVIDIA RTX A5000 24GB	$51.82 27.77 TFLOPs	$51.82 27.77 TFLOPs	$5.62 256 Cores	$59.96 24 GB	$1.87 768 GB/s	$3.24 444.4 TOPs	$1,439	64
NVIDIA A100 PCIe 80GB	$115.38 156 TFLOPs	$57.69 312 TFLOPs	$41.66 432 Cores	$224.99 80 GB	$9.30 1935 GB/s	$28.84 624 TOPs	$17,999	16
NVIDIA Tesla P100 16GB	$18.86 10.6 TFLOPs	$9.43 21.2 TFLOPs	$∞ n/a	$12.50 16 GB	$0.27 732 GB/s	$∞ n/a	$200	100
NVIDIA Geforce RTX 4090 24GB	$27.91 82.6 TFLOPs	$3.49 660.6 TFLOPs	$4.50 512 Cores	$96.07 24 GB	$2.29 1008 GB/s	$1.75 1321.2 TOPs	$2,306	100
NVIDIA Tesla V100 32GB	$125.00 14 TFLOPs	$62.50 28 TFLOPs	$2.73 640 Cores	$54.69 32 GB	$1.94 900 GB/s	$31.25 56 TOPs	$1,750	38
NVIDIA H100 PCIe 80GB	$35.52 756 TFLOPs	$17.75 1513 TFLOPs	$58.89 456 Cores	$335.67 80 GB	$13.17 2039 GB/s	$8.87 3026 TOPs	$26,854	13
AMD Radeon RX 7900 XTX 24GB	$16.23 61 TFLOPs	$8.05 123 TFLOPs	$5.16 192 Cores	$41.25 24 GB	$1.03 960 GB/s	$8.05 123 TOPs	$990	84
NVIDIA L40S 48GB	n/a 183 TFLOPs	n/a 362 TFLOPs	n/a 568 Cores	n/a 48 GB	n/a 864 GB/s	n/a 1466 TOPs	n/a	0
NVIDIA Tesla V100 16GB	$43.89 14 TFLOPs	$21.94 28 TFLOPs	$0.96 640 Cores	$38.40 16 GB	$0.68 900 GB/s	$10.97 56 TOPs	$614	48
AMD Radeon RX 7700 XT 12GB	$12.00 35 TFLOPs	$6.00 70 TFLOPs	$3.89 108 Cores	$35.00 12 GB	$0.97 432 GB/s	$∞ n/a	$420	41
AMD Radeon RX 7800 XT 16GB	$16.16 37 TFLOPs	$8.08 74 TFLOPs	$4.98 120 Cores	$37.38 16 GB	$0.96 624 GB/s	$∞ n/a	$598	68
AMD Radeon RX 7600 XT 16GB	$19.49 22.57 TFLOPs	$9.75 45.14 TFLOPs	$6.87 64 Cores	$27.50 16 GB	$1.53 288 GB/s	$∞ n/a	$440	13
NVIDIA GeForce RTX 5080 16GB	$12.39 112.6 TFLOPs	$3.10 450.2 TFLOPs	$4.15 336 Cores	$87.19 16 GB	$1.45 960 GB/s	$1.55 900.4 TOPs	$1,395	100
NVIDIA GeForce RTX 5090 32GB	$17.37 209.5 TFLOPs	$4.34 838 TFLOPs	$5.35 680 Cores	$113.75 32 GB	$2.03 1792 GB/s	$2.17 1676 TOPs	$3,640	55
NVIDIA GeForce RTX 5070 Ti 16GB	$9.06 112.6 TFLOPs	$2.27 450.2 TFLOPs	$3.04 336 Cores	$63.75 16 GB	$1.06 960 GB/s	$1.13 900.4 TOPs	$1,020	76
NVIDIA Geforce RTX 4070 12GB	$8.57 58.2 TFLOPs	$2.14 233.2 TFLOPs	$2.71 184 Cores	$41.54 12 GB	$0.99 504 GB/s	$1.07 466.4 TOPs	$499	50
NVIDIA Geforce RTX 4070 Ti 12GB	$8.98 80.2 TFLOPs	$2.24 320.8 TFLOPs	$3.00 240 Cores	$60.00 12 GB	$1.43 504 GB/s	$1.12 641.4 TOPs	$720	43
NVIDIA Geforce RTX 4080 16GB	$11.12 97.4 TFLOPs	$2.72 398.8 TFLOPs	$3.56 304 Cores	$67.68 16 GB	$1.51 716.8 GB/s	$1.39 779.82 TOPs	$1,083	83