GPUs Ranked by Cost per Memory Bandwidth (GB/s)

Something missing? Let us know and we'll add it if we can.

GPU	$ / FP32 TFLOPs	$ / FP16 TFLOPs	$ / Tensor Core Count	$ / Memory Capacity (GB)	$ / Memory Bandwidth (GB/s)	$ / Int8 TOPs	Minimum Price	Available for Sale
NVIDIA T4 16GB	$72.22 8.1 TFLOPs	$9.00 65 TFLOPs	$1.83 320 Cores	$36.56 16 GB	$1.83 320 GB/s	$4.50 130 TOPs	$585	85
NVIDIA A30 24GB	$15.15 165 TFLOPs	$15.15 165 TFLOPs	$11.16 224 Cores	$104.13 24 GB	$2.68 933.3 GB/s	$7.57 330 TOPs	$2,499	40
NVIDIA A40 48GB	$133.66 37.4 TFLOPs	$133.66 37.4 TFLOPs	$14.88 336 Cores	$104.15 48 GB	$7.18 696 GB/s	$16.70 299.3 TOPs	$4,999	28
NVIDIA A10 24GB	$43.27 31.2 TFLOPs	$10.80 125 TFLOPs	$4.69 288 Cores	$56.25 24 GB	$2.25 600 GB/s	$5.40 250 TOPs	$1,350	65
NVIDIA L40 48GB	$60.22 90.5 TFLOPs	$30.10 181.05 TFLOPs	$9.60 568 Cores	$113.54 48 GB	$6.31 864 GB/s	$15.06 362 TOPs	$5,450	27
AMD Radeon RX 7900 XT 20GB	$11.06 52 TFLOPs	$5.58 103 TFLOPs	$3.42 168 Cores	$28.75 20 GB	$0.72 800 GB/s	$5.58 103 TOPs	$575	96
NVIDIA L4 24GB	$15.83 120 TFLOPs	$7.85 242 TFLOPs	$7.91 240 Cores	$79.13 24 GB	$6.33 300 GB/s	$3.92 485 TOPs	$1,899	54
NVIDIA RTX A5000 24GB	$48.61 27.77 TFLOPs	$48.61 27.77 TFLOPs	$5.27 256 Cores	$56.25 24 GB	$1.76 768 GB/s	$3.04 444.4 TOPs	$1,350	85
NVIDIA A100 PCIe 80GB	$73.72 156 TFLOPs	$36.86 312 TFLOPs	$26.62 432 Cores	$143.75 80 GB	$5.94 1935 GB/s	$18.43 624 TOPs	$11,500	10
NVIDIA Tesla P100 16GB	$12.07 10.6 TFLOPs	$6.04 21.2 TFLOPs	$∞ n/a	$8.00 16 GB	$0.17 732 GB/s	$∞ n/a	$128	99
NVIDIA Geforce RTX 4090 24GB	$27.84 82.6 TFLOPs	$3.48 660.6 TFLOPs	$4.49 512 Cores	$95.83 24 GB	$2.28 1008 GB/s	$1.74 1321.2 TOPs	$2,300	90
NVIDIA Tesla V100 32GB	$77.81 14 TFLOPs	$38.90 28 TFLOPs	$1.70 640 Cores	$34.04 32 GB	$1.21 900 GB/s	$19.45 56 TOPs	$1,089	44
NVIDIA H100 PCIe 80GB	$36.92 756 TFLOPs	$18.45 1513 TFLOPs	$61.21 456 Cores	$348.91 80 GB	$13.69 2039 GB/s	$9.22 3026 TOPs	$27,913	10
AMD Radeon RX 7900 XTX 24GB	$11.48 61 TFLOPs	$5.69 123 TFLOPs	$3.65 192 Cores	$29.17 24 GB	$0.73 960 GB/s	$5.69 123 TOPs	$700	100
NVIDIA L40S 48GB	$43.58 183 TFLOPs	$22.03 362 TFLOPs	$14.04 568 Cores	$166.15 48 GB	$9.23 864 GB/s	$5.44 1466 TOPs	$7,975	29
NVIDIA Tesla V100 16GB	$29.29 14 TFLOPs	$14.64 28 TFLOPs	$0.64 640 Cores	$25.63 16 GB	$0.46 900 GB/s	$7.32 56 TOPs	$410	62
AMD Radeon RX 7700 XT 12GB	$10.43 35 TFLOPs	$5.21 70 TFLOPs	$3.38 108 Cores	$30.42 12 GB	$0.84 432 GB/s	$∞ n/a	$365	62
AMD Radeon RX 7800 XT 16GB	$10.81 37 TFLOPs	$5.41 74 TFLOPs	$3.33 120 Cores	$25.00 16 GB	$0.64 624 GB/s	$∞ n/a	$400	89
AMD Radeon RX 7600 XT 16GB	$13.96 22.57 TFLOPs	$6.98 45.14 TFLOPs	$4.92 64 Cores	$19.69 16 GB	$1.09 288 GB/s	$∞ n/a	$315	14
NVIDIA GeForce RTX 5080 16GB	$10.21 112.6 TFLOPs	$2.55 450.2 TFLOPs	$3.42 336 Cores	$71.88 16 GB	$1.20 960 GB/s	$1.28 900.4 TOPs	$1,150	99
NVIDIA GeForce RTX 5090 32GB	$11.04 209.5 TFLOPs	$2.76 838 TFLOPs	$3.40 680 Cores	$72.29 32 GB	$1.29 1792 GB/s	$1.38 1676 TOPs	$2,313	100
NVIDIA GeForce RTX 5070 Ti 16GB	$6.57 112.6 TFLOPs	$1.64 450.2 TFLOPs	$2.20 336 Cores	$46.25 16 GB	$0.77 960 GB/s	$0.82 900.4 TOPs	$740	98
NVIDIA Geforce RTX 4070 12GB	$8.16 58.2 TFLOPs	$2.04 233.2 TFLOPs	$2.58 184 Cores	$39.58 12 GB	$0.94 504 GB/s	$1.02 466.4 TOPs	$475	94
NVIDIA Geforce RTX 4070 Ti 12GB	$8.18 80.2 TFLOPs	$2.04 320.8 TFLOPs	$2.73 240 Cores	$54.64 12 GB	$1.30 504 GB/s	$1.02 641.4 TOPs	$656	32
NVIDIA Geforce RTX 4080 16GB	$9.23 97.4 TFLOPs	$2.25 398.8 TFLOPs	$2.96 304 Cores	$56.19 16 GB	$1.25 716.8 GB/s	$1.15 779.82 TOPs	$899	97