GPUs Ranked by Cost per Memory Bandwidth (GB/s)

Something missing? Let us know and we'll add it if we can.

GPU	$ / FP32 TFLOPs	$ / FP16 TFLOPs	$ / Tensor Core Count	$ / Memory Capacity (GB)	$ / Memory Bandwidth (GB/s)	$ / Int8 TOPs	Minimum Price	Available for Sale
NVIDIA T4 16GB	$72.84 8.1 TFLOPs	$9.08 65 TFLOPs	$1.84 320 Cores	$36.88 16 GB	$1.84 320 GB/s	$4.54 130 TOPs	$590	88
NVIDIA A30 24GB	$19.03 165 TFLOPs	$19.03 165 TFLOPs	$14.02 224 Cores	$130.83 24 GB	$3.36 933.3 GB/s	$9.52 330 TOPs	$3,140	34
NVIDIA A40 48GB	$177.79 37.4 TFLOPs	$177.79 37.4 TFLOPs	$19.79 336 Cores	$138.53 48 GB	$9.55 696 GB/s	$22.22 299.3 TOPs	$6,649	23
NVIDIA A10 24GB	$54.78 31.2 TFLOPs	$13.67 125 TFLOPs	$5.93 288 Cores	$71.21 24 GB	$2.85 600 GB/s	$6.84 250 TOPs	$1,709	59
NVIDIA L40 48GB	$63.54 90.5 TFLOPs	$31.76 181.05 TFLOPs	$10.12 568 Cores	$119.79 48 GB	$6.66 864 GB/s	$15.88 362 TOPs	$5,750	29
AMD Radeon RX 7900 XT 20GB	$13.44 52 TFLOPs	$6.79 103 TFLOPs	$4.16 168 Cores	$34.95 20 GB	$0.87 800 GB/s	$6.79 103 TOPs	$699	76
NVIDIA L4 24GB	$16.66 120 TFLOPs	$8.26 242 TFLOPs	$8.33 240 Cores	$83.32 24 GB	$6.67 300 GB/s	$4.12 485 TOPs	$2,000	35
NVIDIA RTX A5000 24GB	$46.81 27.77 TFLOPs	$46.81 27.77 TFLOPs	$5.08 256 Cores	$54.16 24 GB	$1.69 768 GB/s	$2.93 444.4 TOPs	$1,300	65
NVIDIA A100 PCIe 80GB	$104.17 156 TFLOPs	$52.08 312 TFLOPs	$37.62 432 Cores	$203.13 80 GB	$8.40 1935 GB/s	$26.04 624 TOPs	$16,250	12
NVIDIA Tesla P100 16GB	$17.45 10.6 TFLOPs	$8.73 21.2 TFLOPs	$∞ n/a	$11.56 16 GB	$0.25 732 GB/s	$∞ n/a	$185	99
NVIDIA Geforce RTX 4090 24GB	$29.00 82.6 TFLOPs	$3.63 660.6 TFLOPs	$4.68 512 Cores	$99.79 24 GB	$2.38 1008 GB/s	$1.81 1321.2 TOPs	$2,395	94
NVIDIA Tesla V100 32GB	$128.57 14 TFLOPs	$64.29 28 TFLOPs	$2.81 640 Cores	$56.25 32 GB	$2.00 900 GB/s	$32.14 56 TOPs	$1,800	35
NVIDIA H100 PCIe 80GB	$36.70 756 TFLOPs	$18.34 1513 TFLOPs	$60.85 456 Cores	$346.82 80 GB	$13.61 2039 GB/s	$9.17 3026 TOPs	$27,745	15
AMD Radeon RX 7900 XTX 24GB	$14.75 61 TFLOPs	$7.32 123 TFLOPs	$4.69 192 Cores	$37.50 24 GB	$0.94 960 GB/s	$7.32 123 TOPs	$900	86
NVIDIA L40S 48GB	$44.72 183 TFLOPs	$22.60 362 TFLOPs	$14.41 568 Cores	$170.48 48 GB	$9.47 864 GB/s	$5.58 1466 TOPs	$8,183	25
NVIDIA Tesla V100 16GB	$42.86 14 TFLOPs	$21.43 28 TFLOPs	$0.94 640 Cores	$37.50 16 GB	$0.67 900 GB/s	$10.71 56 TOPs	$600	43
AMD Radeon RX 7700 XT 12GB	$12.86 35 TFLOPs	$6.43 70 TFLOPs	$4.17 108 Cores	$37.50 12 GB	$1.04 432 GB/s	$∞ n/a	$450	43
AMD Radeon RX 7800 XT 16GB	$16.22 37 TFLOPs	$8.11 74 TFLOPs	$5.00 120 Cores	$37.50 16 GB	$0.96 624 GB/s	$∞ n/a	$600	57
AMD Radeon RX 7600 XT 16GB	$17.72 22.57 TFLOPs	$8.86 45.14 TFLOPs	$6.25 64 Cores	$25.00 16 GB	$1.39 288 GB/s	$∞ n/a	$400	9
NVIDIA GeForce RTX 5080 16GB	$12.88 112.6 TFLOPs	$3.22 450.2 TFLOPs	$4.32 336 Cores	$90.62 16 GB	$1.51 960 GB/s	$1.61 900.4 TOPs	$1,450	100
NVIDIA GeForce RTX 5090 32GB	$16.22 209.5 TFLOPs	$4.05 838 TFLOPs	$5.00 680 Cores	$106.19 32 GB	$1.90 1792 GB/s	$2.03 1676 TOPs	$3,398	74
NVIDIA GeForce RTX 5070 Ti 16GB	$8.97 112.6 TFLOPs	$2.24 450.2 TFLOPs	$3.01 336 Cores	$63.12 16 GB	$1.05 960 GB/s	$1.12 900.4 TOPs	$1,010	82
NVIDIA Geforce RTX 4070 12GB	$9.88 58.2 TFLOPs	$2.47 233.2 TFLOPs	$3.13 184 Cores	$47.92 12 GB	$1.14 504 GB/s	$1.23 466.4 TOPs	$575	64
NVIDIA Geforce RTX 4070 Ti 12GB	$8.73 80.2 TFLOPs	$2.18 320.8 TFLOPs	$2.92 240 Cores	$58.33 12 GB	$1.39 504 GB/s	$1.09 641.4 TOPs	$700	37
NVIDIA Geforce RTX 4080 16GB	$10.77 97.4 TFLOPs	$2.63 398.8 TFLOPs	$3.45 304 Cores	$65.56 16 GB	$1.46 716.8 GB/s	$1.35 779.82 TOPs	$1,049	68