GPUs Ranked by Cost per Memory Bandwidth (GB/s)

Something missing? Let us know and we'll add it if we can.

GPU	$ / FP32 TFLOPs	$ / FP16 TFLOPs	$ / Tensor Core Count	$ / Memory Capacity (GB)	$ / Memory Bandwidth (GB/s)	$ / Int8 TOPs	Minimum Price	Available for Sale
NVIDIA T4 16GB	$76.54 8.1 TFLOPs	$9.54 65 TFLOPs	$1.94 320 Cores	$38.75 16 GB	$1.94 320 GB/s	$4.77 130 TOPs	$620	71
NVIDIA A30 24GB	$17.88 165 TFLOPs	$17.88 165 TFLOPs	$13.17 224 Cores	$122.92 24 GB	$3.16 933.3 GB/s	$8.94 330 TOPs	$2,950	34
NVIDIA A40 48GB	$120.32 37.4 TFLOPs	$120.32 37.4 TFLOPs	$13.39 336 Cores	$93.75 48 GB	$6.47 696 GB/s	$15.04 299.3 TOPs	$4,500	28
NVIDIA A10 24GB	$63.11 31.2 TFLOPs	$15.75 125 TFLOPs	$6.84 288 Cores	$82.05 24 GB	$3.28 600 GB/s	$7.88 250 TOPs	$1,969	61
NVIDIA L40 48GB	$60.54 90.5 TFLOPs	$30.26 181.05 TFLOPs	$9.65 568 Cores	$114.15 48 GB	$6.34 864 GB/s	$15.14 362 TOPs	$5,479	29
AMD Radeon RX 7900 XT 20GB	$18.26 52 TFLOPs	$9.22 103 TFLOPs	$5.65 168 Cores	$47.49 20 GB	$1.19 800 GB/s	$9.22 103 TOPs	$950	31
NVIDIA L4 24GB	$15.83 120 TFLOPs	$7.85 242 TFLOPs	$7.92 240 Cores	$79.17 24 GB	$6.33 300 GB/s	$3.92 485 TOPs	$1,900	27
NVIDIA RTX A5000 24GB	$47.89 27.77 TFLOPs	$47.89 27.77 TFLOPs	$5.20 256 Cores	$55.42 24 GB	$1.73 768 GB/s	$2.99 444.4 TOPs	$1,330	61
NVIDIA A100 PCIe 80GB	$115.38 156 TFLOPs	$57.69 312 TFLOPs	$41.66 432 Cores	$224.99 80 GB	$9.30 1935 GB/s	$28.84 624 TOPs	$17,999	12
NVIDIA Tesla P100 16GB	$18.87 10.6 TFLOPs	$9.43 21.2 TFLOPs	$∞ n/a	$12.50 16 GB	$0.27 732 GB/s	$∞ n/a	$200	89
NVIDIA RTX 4090 24GB	$29.06 82.6 TFLOPs	$3.63 660.6 TFLOPs	$4.69 512 Cores	$100.00 24 GB	$2.38 1008 GB/s	$1.82 1321.2 TOPs	$2,400	99
NVIDIA Tesla V100 32GB	$128.57 14 TFLOPs	$64.29 28 TFLOPs	$2.81 640 Cores	$56.25 32 GB	$2.00 900 GB/s	$32.14 56 TOPs	$1,800	33
NVIDIA H100 PCIe 80GB	$29.76 756 TFLOPs	$14.87 1513 TFLOPs	$49.34 456 Cores	$281.25 80 GB	$11.03 2039 GB/s	$7.44 3026 TOPs	$22,500	13
AMD Radeon RX 7900 XTX 24GB	$16.80 61 TFLOPs	$8.33 123 TFLOPs	$5.34 192 Cores	$42.70 24 GB	$1.07 960 GB/s	$8.33 123 TOPs	$1,025	66
NVIDIA L40S 48GB	$38.52 183 TFLOPs	$19.48 362 TFLOPs	$12.41 568 Cores	$146.87 48 GB	$8.16 864 GB/s	$4.81 1466 TOPs	$7,050	30
NVIDIA Tesla V100 16GB	$45.71 14 TFLOPs	$22.86 28 TFLOPs	$1.00 640 Cores	$40.00 16 GB	$0.71 900 GB/s	$11.43 56 TOPs	$640	44
AMD Radeon RX 7700 XT 12GB	$13.14 35 TFLOPs	$6.57 70 TFLOPs	$4.26 108 Cores	$38.33 12 GB	$1.06 432 GB/s	$∞ n/a	$460	29
AMD Radeon RX 7800 XT 16GB	$17.16 37 TFLOPs	$8.58 74 TFLOPs	$5.29 120 Cores	$39.69 16 GB	$1.02 624 GB/s	$∞ n/a	$635	47
AMD Radeon RX 7600 XT 16GB	$20.10 22.57 TFLOPs	$10.05 45.14 TFLOPs	$7.09 64 Cores	$28.35 16 GB	$1.58 288 GB/s	$∞ n/a	$454	10
NVIDIA RTX 5090 32GB	$13.51 317.5 TFLOPs	$5.12 838 TFLOPs	$6.31 680 Cores	$134.06 32 GB	$2.39 1792 GB/s	$2.56 1676 TOPs	$4,290	57