GPUs Ranked by Cost per FP16 TFLOPs

Something missing? Let us know and we'll add it if we can.

GPU	$ / FP32 TFLOPs	$ / FP16 TFLOPs	$ / Tensor Core Count	$ / Memory Capacity (GB)	$ / Memory Bandwidth (GB/s)	$ / Int8 TOPs	Minimum Price	Available for Sale
AMD Radeon RX 7600 XT 16GB	$12.36 22.57 TFLOPs	$6.18 45.14 TFLOPs	$4.36 64 Cores	$17.44 16 GB	$0.97 288 GB/s	$∞ n/a	$279	14
AMD Radeon RX 7700 XT 12GB	$9.14 35 TFLOPs	$4.57 70 TFLOPs	$2.96 108 Cores	$26.67 12 GB	$0.74 432 GB/s	$∞ n/a	$320	58
AMD Radeon RX 7800 XT 16GB	$10.81 37 TFLOPs	$5.41 74 TFLOPs	$3.33 120 Cores	$25.00 16 GB	$0.64 624 GB/s	$∞ n/a	$400	63
AMD Radeon RX 7900 XT 20GB	$6.15 52 TFLOPs	$3.11 103 TFLOPs	$1.90 168 Cores	$16.00 20 GB	$0.40 800 GB/s	$3.11 103 TOPs	$320	85
AMD Radeon RX 7900 XTX 24GB	$1.89 61 TFLOPs	$0.93 123 TFLOPs	$0.60 192 Cores	$4.79 24 GB	$0.12 960 GB/s	$0.93 123 TOPs	$115	99
NVIDIA A10 24GB	$41.67 31.2 TFLOPs	$10.40 125 TFLOPs	$4.51 288 Cores	$54.17 24 GB	$2.17 600 GB/s	$5.20 250 TOPs	$1,300	71
NVIDIA A100 PCIe 80GB	$58.65 156 TFLOPs	$29.33 312 TFLOPs	$21.18 432 Cores	$114.38 80 GB	$4.73 1935 GB/s	$14.66 624 TOPs	$9,150	16
NVIDIA A30 24GB	$17.88 165 TFLOPs	$17.88 165 TFLOPs	$13.17 224 Cores	$122.92 24 GB	$3.16 933.3 GB/s	$8.94 330 TOPs	$2,950	52
NVIDIA A40 48GB	$113.71 37.4 TFLOPs	$113.71 37.4 TFLOPs	$12.66 336 Cores	$88.60 48 GB	$6.11 696 GB/s	$14.21 299.3 TOPs	$4,253	31
NVIDIA Geforce RTX 4070 Ti 12GB	$7.09 80.2 TFLOPs	$1.77 320.8 TFLOPs	$2.37 240 Cores	$47.42 12 GB	$1.13 504 GB/s	$0.89 641.4 TOPs	$569	46
NVIDIA Geforce RTX 4070 12GB	$7.60 58.2 TFLOPs	$1.90 233.2 TFLOPs	$2.40 184 Cores	$36.86 12 GB	$0.88 504 GB/s	$0.95 466.4 TOPs	$442	78
NVIDIA Geforce RTX 4080 16GB	$7.85 97.4 TFLOPs	$1.92 398.8 TFLOPs	$2.52 304 Cores	$47.81 16 GB	$1.07 716.8 GB/s	$0.98 779.82 TOPs	$765	100
NVIDIA Geforce RTX 4090 24GB	$26.62 82.6 TFLOPs	$3.33 660.6 TFLOPs	$4.29 512 Cores	$91.63 24 GB	$2.18 1008 GB/s	$1.66 1321.2 TOPs	$2,199	94
NVIDIA GeForce RTX 5070 Ti 16GB	$6.39 112.6 TFLOPs	$1.60 450.2 TFLOPs	$2.14 336 Cores	$45.00 16 GB	$0.75 960 GB/s	$0.80 900.4 TOPs	$720	99
NVIDIA GeForce RTX 5080 16GB	$8.88 112.6 TFLOPs	$2.22 450.2 TFLOPs	$2.98 336 Cores	$62.50 16 GB	$1.04 960 GB/s	$1.11 900.4 TOPs	$1,000	96
NVIDIA H100 PCIe 80GB	$36.03 756 TFLOPs	$18.01 1513 TFLOPs	$59.74 456 Cores	$340.53 80 GB	$13.36 2039 GB/s	$9.00 3026 TOPs	$27,242	12
NVIDIA L4 24GB	$17.08 120 TFLOPs	$8.47 242 TFLOPs	$8.54 240 Cores	$85.42 24 GB	$6.83 300 GB/s	$4.23 485 TOPs	$2,050	50
NVIDIA L40 48GB	$69.28 90.5 TFLOPs	$34.63 181.05 TFLOPs	$11.04 568 Cores	$130.62 48 GB	$7.26 864 GB/s	$17.32 362 TOPs	$6,270	26
NVIDIA L40S 48GB	$39.62 183 TFLOPs	$20.03 362 TFLOPs	$12.76 568 Cores	$151.04 48 GB	$8.39 864 GB/s	$4.95 1466 TOPs	$7,250	42
NVIDIA RTX A5000 24GB	$48.61 27.77 TFLOPs	$48.61 27.77 TFLOPs	$5.27 256 Cores	$56.25 24 GB	$1.76 768 GB/s	$3.04 444.4 TOPs	$1,350	78
NVIDIA T4 16GB	$9.88 8.1 TFLOPs	$1.23 65 TFLOPs	$0.25 320 Cores	$5.00 16 GB	$0.25 320 GB/s	$0.62 130 TOPs	$80	91
NVIDIA Tesla P100 16GB	$9.24 10.6 TFLOPs	$4.62 21.2 TFLOPs	$∞ n/a	$6.12 16 GB	$0.13 732 GB/s	$∞ n/a	$98	100
NVIDIA Tesla V100 16GB	$20.00 14 TFLOPs	$10.00 28 TFLOPs	$0.44 640 Cores	$17.50 16 GB	$0.31 900 GB/s	$5.00 56 TOPs	$280	66
NVIDIA Tesla V100 32GB	$50.00 14 TFLOPs	$25.00 28 TFLOPs	$1.09 640 Cores	$21.87 32 GB	$0.78 900 GB/s	$12.50 56 TOPs	$700	61
NVIDIA GeForce RTX 5090 32GB	$12.17 209.5 TFLOPs	$3.04 838 TFLOPs	$3.75 680 Cores	$79.66 32 GB	$1.42 1792 GB/s	$1.52 1676 TOPs	$2,549	100