GPUs Ranked by Cost per Memory Bandwidth (GB/s)

Something missing? Let us know and we'll add it if we can.

GPU	$ / FP32 TFLOPs	$ / FP16 TFLOPs	$ / Tensor Core Count	$ / Memory Capacity (GB)	$ / Memory Bandwidth (GB/s)	$ / Int8 TOPs	Minimum Price	Available for Sale
NVIDIA T4 16GB	$70.99 8.1 TFLOPs	$8.85 65 TFLOPs	$1.80 320 Cores	$35.94 16 GB	$1.80 320 GB/s	$4.42 130 TOPs	$575	84
NVIDIA A30 24GB	$19.39 165 TFLOPs	$19.39 165 TFLOPs	$14.29 224 Cores	$133.33 24 GB	$3.43 933.3 GB/s	$9.70 330 TOPs	$3,200	42
NVIDIA A40 48GB	$112.30 37.4 TFLOPs	$112.30 37.4 TFLOPs	$12.50 336 Cores	$87.50 48 GB	$6.03 696 GB/s	$14.03 299.3 TOPs	$4,200	35
NVIDIA A10 24GB	$44.84 31.2 TFLOPs	$11.19 125 TFLOPs	$4.86 288 Cores	$58.29 24 GB	$2.33 600 GB/s	$5.60 250 TOPs	$1,399	65
NVIDIA L40 48GB	$60.22 90.5 TFLOPs	$30.10 181.05 TFLOPs	$9.60 568 Cores	$113.54 48 GB	$6.31 864 GB/s	$15.06 362 TOPs	$5,450	29
AMD Radeon RX 7900 XT 20GB	$10.00 52 TFLOPs	$5.05 103 TFLOPs	$3.10 168 Cores	$26.00 20 GB	$0.65 800 GB/s	$5.05 103 TOPs	$520	86
NVIDIA L4 24GB	$15.58 120 TFLOPs	$7.73 242 TFLOPs	$7.79 240 Cores	$77.92 24 GB	$6.23 300 GB/s	$3.86 485 TOPs	$1,870	52
NVIDIA RTX A5000 24GB	$54.02 27.77 TFLOPs	$54.02 27.77 TFLOPs	$5.86 256 Cores	$62.50 24 GB	$1.95 768 GB/s	$3.38 444.4 TOPs	$1,500	71
NVIDIA A100 PCIe 80GB	$66.99 156 TFLOPs	$33.49 312 TFLOPs	$24.19 432 Cores	$130.63 80 GB	$5.40 1935 GB/s	$16.75 624 TOPs	$10,450	11
NVIDIA Tesla P100 16GB	$9.24 10.6 TFLOPs	$4.62 21.2 TFLOPs	$∞ n/a	$6.12 16 GB	$0.13 732 GB/s	$∞ n/a	$98	98
NVIDIA Geforce RTX 4090 24GB	$0.96 82.6 TFLOPs	$0.12 660.6 TFLOPs	$0.15 512 Cores	$3.29 24 GB	$0.08 1008 GB/s	$0.06 1321.2 TOPs	$79	98
NVIDIA Tesla V100 32GB	$77.59 14 TFLOPs	$38.80 28 TFLOPs	$1.70 640 Cores	$33.95 32 GB	$1.21 900 GB/s	$19.40 56 TOPs	$1,086	52
NVIDIA H100 PCIe 80GB	$36.83 756 TFLOPs	$18.40 1513 TFLOPs	$61.07 456 Cores	$348.07 80 GB	$13.66 2039 GB/s	$9.20 3026 TOPs	$27,846	10
AMD Radeon RX 7900 XTX 24GB	$11.48 61 TFLOPs	$5.69 123 TFLOPs	$3.65 192 Cores	$29.17 24 GB	$0.73 960 GB/s	$5.69 123 TOPs	$700	100
NVIDIA L40S 48GB	$38.25 183 TFLOPs	$19.34 362 TFLOPs	$12.32 568 Cores	$145.83 48 GB	$8.10 864 GB/s	$4.77 1466 TOPs	$7,000	33
NVIDIA Tesla V100 16GB	$25.00 14 TFLOPs	$12.50 28 TFLOPs	$0.55 640 Cores	$21.88 16 GB	$0.39 900 GB/s	$6.25 56 TOPs	$350	65
AMD Radeon RX 7700 XT 12GB	$11.14 35 TFLOPs	$5.57 70 TFLOPs	$3.61 108 Cores	$32.50 12 GB	$0.90 432 GB/s	$∞ n/a	$390	45
AMD Radeon RX 7800 XT 16GB	$13.38 37 TFLOPs	$6.69 74 TFLOPs	$4.12 120 Cores	$30.94 16 GB	$0.79 624 GB/s	$∞ n/a	$495	69
AMD Radeon RX 7600 XT 16GB	$14.18 22.57 TFLOPs	$7.09 45.14 TFLOPs	$5.00 64 Cores	$20.00 16 GB	$1.11 288 GB/s	$∞ n/a	$320	16
NVIDIA GeForce RTX 5080 16GB	$8.87 112.6 TFLOPs	$2.22 450.2 TFLOPs	$2.97 336 Cores	$62.44 16 GB	$1.04 960 GB/s	$1.11 900.4 TOPs	$999	98
NVIDIA GeForce RTX 5090 32GB	$10.50 209.5 TFLOPs	$2.63 838 TFLOPs	$3.24 680 Cores	$68.75 32 GB	$1.23 1792 GB/s	$1.31 1676 TOPs	$2,200	99
NVIDIA GeForce RTX 5070 Ti 16GB	$6.57 112.6 TFLOPs	$1.64 450.2 TFLOPs	$2.20 336 Cores	$46.25 16 GB	$0.77 960 GB/s	$0.82 900.4 TOPs	$740	100
NVIDIA Geforce RTX 4070 12GB	$7.22 58.2 TFLOPs	$1.80 233.2 TFLOPs	$2.28 184 Cores	$35.00 12 GB	$0.83 504 GB/s	$0.90 466.4 TOPs	$420	100
NVIDIA Geforce RTX 4070 Ti 12GB	$7.22 80.2 TFLOPs	$1.80 320.8 TFLOPs	$2.41 240 Cores	$48.25 12 GB	$1.15 504 GB/s	$0.90 641.4 TOPs	$579	32
NVIDIA Geforce RTX 4080 16GB	$7.70 97.4 TFLOPs	$1.88 398.8 TFLOPs	$2.47 304 Cores	$46.87 16 GB	$1.05 716.8 GB/s	$0.96 779.82 TOPs	$750	99