GPUs Ranked by Cost per Memory Bandwidth (GB/s)

Something missing? Let us know and we'll add it if we can.

GPU	$ / FP32 TFLOPs	$ / FP16 TFLOPs	$ / Tensor Core Count	$ / Memory Capacity (GB)	$ / Memory Bandwidth (GB/s)	$ / Int8 TOPs	Minimum Price	Available for Sale
NVIDIA T4 16GB	$66.67 8.1 TFLOPs	$8.31 65 TFLOPs	$1.69 320 Cores	$33.75 16 GB	$1.69 320 GB/s	$4.15 130 TOPs	$540	97
NVIDIA A30 24GB	$13.94 165 TFLOPs	$13.94 165 TFLOPs	$10.27 224 Cores	$95.83 24 GB	$2.46 933.3 GB/s	$6.97 330 TOPs	$2,300	42
NVIDIA A40 48GB	$140.37 37.4 TFLOPs	$140.37 37.4 TFLOPs	$15.63 336 Cores	$109.38 48 GB	$7.54 696 GB/s	$17.54 299.3 TOPs	$5,250	29
NVIDIA A10 24GB	$44.84 31.2 TFLOPs	$11.19 125 TFLOPs	$4.86 288 Cores	$58.29 24 GB	$2.33 600 GB/s	$5.60 250 TOPs	$1,399	65
NVIDIA L40 48GB	$60.22 90.5 TFLOPs	$30.10 181.05 TFLOPs	$9.60 568 Cores	$113.54 48 GB	$6.31 864 GB/s	$15.06 362 TOPs	$5,450	26
AMD Radeon RX 7900 XT 20GB	$10.56 52 TFLOPs	$5.33 103 TFLOPs	$3.27 168 Cores	$27.45 20 GB	$0.69 800 GB/s	$5.33 103 TOPs	$549	92
NVIDIA L4 24GB	$15.42 120 TFLOPs	$7.64 242 TFLOPs	$7.71 240 Cores	$77.08 24 GB	$6.17 300 GB/s	$3.81 485 TOPs	$1,850	55
NVIDIA RTX A5000 24GB	$46.74 27.77 TFLOPs	$46.74 27.77 TFLOPs	$5.07 256 Cores	$54.08 24 GB	$1.69 768 GB/s	$2.92 444.4 TOPs	$1,298	83
NVIDIA A100 PCIe 80GB	$67.29 156 TFLOPs	$33.65 312 TFLOPs	$24.30 432 Cores	$131.23 80 GB	$5.43 1935 GB/s	$16.82 624 TOPs	$10,498	12
NVIDIA Tesla P100 16GB	$11.32 10.6 TFLOPs	$5.66 21.2 TFLOPs	$∞ n/a	$7.50 16 GB	$0.16 732 GB/s	$∞ n/a	$120	99
NVIDIA Geforce RTX 4090 24GB	$26.63 82.6 TFLOPs	$3.33 660.6 TFLOPs	$4.30 512 Cores	$91.67 24 GB	$2.18 1008 GB/s	$1.67 1321.2 TOPs	$2,200	100
NVIDIA Tesla V100 32GB	$78.57 14 TFLOPs	$39.29 28 TFLOPs	$1.72 640 Cores	$34.37 32 GB	$1.22 900 GB/s	$19.64 56 TOPs	$1,100	51
NVIDIA H100 PCIe 80GB	$36.83 756 TFLOPs	$18.40 1513 TFLOPs	$61.07 456 Cores	$348.07 80 GB	$13.66 2039 GB/s	$9.20 3026 TOPs	$27,846	10
AMD Radeon RX 7900 XTX 24GB	$11.89 61 TFLOPs	$5.89 123 TFLOPs	$3.78 192 Cores	$30.21 24 GB	$0.76 960 GB/s	$5.89 123 TOPs	$725	100
NVIDIA L40S 48GB	$41.12 183 TFLOPs	$20.79 362 TFLOPs	$13.25 568 Cores	$156.77 48 GB	$8.71 864 GB/s	$5.13 1466 TOPs	$7,525	29
NVIDIA Tesla V100 16GB	$27.89 14 TFLOPs	$13.95 28 TFLOPs	$0.61 640 Cores	$24.41 16 GB	$0.43 900 GB/s	$6.97 56 TOPs	$390	59
AMD Radeon RX 7700 XT 12GB	$10.28 35 TFLOPs	$5.14 70 TFLOPs	$3.33 108 Cores	$29.98 12 GB	$0.83 432 GB/s	$∞ n/a	$360	61
AMD Radeon RX 7800 XT 16GB	$12.30 37 TFLOPs	$6.15 74 TFLOPs	$3.79 120 Cores	$28.44 16 GB	$0.73 624 GB/s	$∞ n/a	$455	75
AMD Radeon RX 7600 XT 16GB	$12.41 22.57 TFLOPs	$6.20 45.14 TFLOPs	$4.38 64 Cores	$17.50 16 GB	$0.97 288 GB/s	$∞ n/a	$280	23
NVIDIA GeForce RTX 5080 16GB	$9.33 112.6 TFLOPs	$2.33 450.2 TFLOPs	$3.13 336 Cores	$65.63 16 GB	$1.09 960 GB/s	$1.17 900.4 TOPs	$1,050	99
NVIDIA GeForce RTX 5090 32GB	$10.97 209.5 TFLOPs	$2.74 838 TFLOPs	$3.38 680 Cores	$71.84 32 GB	$1.28 1792 GB/s	$1.37 1676 TOPs	$2,299	99
NVIDIA GeForce RTX 5070 Ti 16GB	$7.10 112.6 TFLOPs	$1.78 450.2 TFLOPs	$2.38 336 Cores	$50.00 16 GB	$0.83 960 GB/s	$0.89 900.4 TOPs	$800	100
NVIDIA Geforce RTX 4070 12GB	$7.56 58.2 TFLOPs	$1.89 233.2 TFLOPs	$2.39 184 Cores	$36.67 12 GB	$0.87 504 GB/s	$0.94 466.4 TOPs	$440	100
NVIDIA Geforce RTX 4070 Ti 12GB	$9.03 80.2 TFLOPs	$2.26 320.8 TFLOPs	$3.02 240 Cores	$60.38 12 GB	$1.44 504 GB/s	$1.13 641.4 TOPs	$725	26
NVIDIA Geforce RTX 4080 16GB	$8.20 97.4 TFLOPs	$2.00 398.8 TFLOPs	$2.63 304 Cores	$49.94 16 GB	$1.11 716.8 GB/s	$1.02 779.82 TOPs	$799	100