GPUs Ranked by Cost per Memory Bandwidth (GB/s)

Something missing? Let us know and we'll add it if we can.

GPU	$ / FP32 TFLOPs	$ / FP16 TFLOPs	$ / Tensor Core Count	$ / Memory Capacity (GB)	$ / Memory Bandwidth (GB/s)	$ / Int8 TOPs	Minimum Price	Available for Sale
NVIDIA T4 16GB	$71.60 8.1 TFLOPs	$8.92 65 TFLOPs	$1.81 320 Cores	$36.25 16 GB	$1.81 320 GB/s	$4.46 130 TOPs	$580	82
NVIDIA A30 24GB	$19.39 165 TFLOPs	$19.39 165 TFLOPs	$14.29 224 Cores	$133.33 24 GB	$3.43 933.3 GB/s	$9.70 330 TOPs	$3,200	45
NVIDIA A40 48GB	$117.65 37.4 TFLOPs	$117.65 37.4 TFLOPs	$13.10 336 Cores	$91.67 48 GB	$6.32 696 GB/s	$14.70 299.3 TOPs	$4,400	36
NVIDIA A10 24GB	$42.31 31.2 TFLOPs	$10.56 125 TFLOPs	$4.58 288 Cores	$55.00 24 GB	$2.20 600 GB/s	$5.28 250 TOPs	$1,320	71
NVIDIA L40 48GB	$56.91 90.5 TFLOPs	$28.45 181.05 TFLOPs	$9.07 568 Cores	$107.29 48 GB	$5.96 864 GB/s	$14.23 362 TOPs	$5,150	28
AMD Radeon RX 7900 XT 20GB	$10.58 52 TFLOPs	$5.34 103 TFLOPs	$3.27 168 Cores	$27.50 20 GB	$0.69 800 GB/s	$5.34 103 TOPs	$550	95
NVIDIA L4 24GB	$14.83 120 TFLOPs	$7.36 242 TFLOPs	$7.42 240 Cores	$74.17 24 GB	$5.93 300 GB/s	$3.67 485 TOPs	$1,780	50
NVIDIA RTX A5000 24GB	$46.78 27.77 TFLOPs	$46.78 27.77 TFLOPs	$5.07 256 Cores	$54.13 24 GB	$1.69 768 GB/s	$2.92 444.4 TOPs	$1,299	73
NVIDIA A100 PCIe 80GB	$62.18 156 TFLOPs	$31.09 312 TFLOPs	$22.45 432 Cores	$121.25 80 GB	$5.01 1935 GB/s	$15.54 624 TOPs	$9,700	13
NVIDIA Tesla P100 16GB	$8.14 10.6 TFLOPs	$4.07 21.2 TFLOPs	$∞ n/a	$5.39 16 GB	$0.12 732 GB/s	$∞ n/a	$86	99
NVIDIA Geforce RTX 4090 24GB	$0.96 82.6 TFLOPs	$0.12 660.6 TFLOPs	$0.15 512 Cores	$3.29 24 GB	$0.08 1008 GB/s	$0.06 1321.2 TOPs	$79	100
NVIDIA Tesla V100 32GB	$74.29 14 TFLOPs	$37.14 28 TFLOPs	$1.62 640 Cores	$32.50 32 GB	$1.16 900 GB/s	$18.57 56 TOPs	$1,040	58
NVIDIA H100 PCIe 80GB	$36.49 756 TFLOPs	$18.23 1513 TFLOPs	$60.49 456 Cores	$344.80 80 GB	$13.53 2039 GB/s	$9.12 3026 TOPs	$27,584	11
AMD Radeon RX 7900 XTX 24GB	$10.59 61 TFLOPs	$5.25 123 TFLOPs	$3.36 192 Cores	$26.91 24 GB	$0.67 960 GB/s	$5.25 123 TOPs	$646	100
NVIDIA L40S 48GB	$40.98 183 TFLOPs	$20.72 362 TFLOPs	$13.20 568 Cores	$156.25 48 GB	$8.68 864 GB/s	$5.12 1466 TOPs	$7,500	35
NVIDIA Tesla V100 16GB	$21.43 14 TFLOPs	$10.71 28 TFLOPs	$0.47 640 Cores	$18.75 16 GB	$0.33 900 GB/s	$5.36 56 TOPs	$300	69
AMD Radeon RX 7700 XT 12GB	$10.00 35 TFLOPs	$5.00 70 TFLOPs	$3.24 108 Cores	$29.17 12 GB	$0.81 432 GB/s	$∞ n/a	$350	52
AMD Radeon RX 7800 XT 16GB	$10.81 37 TFLOPs	$5.41 74 TFLOPs	$3.33 120 Cores	$25.00 16 GB	$0.64 624 GB/s	$∞ n/a	$400	86
AMD Radeon RX 7600 XT 16GB	$13.29 22.57 TFLOPs	$6.65 45.14 TFLOPs	$4.69 64 Cores	$18.75 16 GB	$1.04 288 GB/s	$∞ n/a	$300	18
NVIDIA GeForce RTX 5080 16GB	$8.44 112.6 TFLOPs	$2.11 450.2 TFLOPs	$2.83 336 Cores	$59.38 16 GB	$0.99 960 GB/s	$1.06 900.4 TOPs	$950	99
NVIDIA GeForce RTX 5090 32GB	$11.93 209.5 TFLOPs	$2.98 838 TFLOPs	$3.68 680 Cores	$78.12 32 GB	$1.40 1792 GB/s	$1.49 1676 TOPs	$2,500	99
NVIDIA GeForce RTX 5070 Ti 16GB	$6.39 112.6 TFLOPs	$1.60 450.2 TFLOPs	$2.14 336 Cores	$45.00 16 GB	$0.75 960 GB/s	$0.80 900.4 TOPs	$720	100
NVIDIA Geforce RTX 4070 12GB	$7.37 58.2 TFLOPs	$1.84 233.2 TFLOPs	$2.33 184 Cores	$35.75 12 GB	$0.85 504 GB/s	$0.92 466.4 TOPs	$429	99
NVIDIA Geforce RTX 4070 Ti 12GB	$7.98 80.2 TFLOPs	$2.00 320.8 TFLOPs	$2.67 240 Cores	$53.33 12 GB	$1.27 504 GB/s	$1.00 641.4 TOPs	$640	38
NVIDIA Geforce RTX 4080 16GB	$7.80 97.4 TFLOPs	$1.91 398.8 TFLOPs	$2.50 304 Cores	$47.50 16 GB	$1.06 716.8 GB/s	$0.97 779.82 TOPs	$760	100