GPUs Ranked by Cost per Memory Capacity (GB)

Something missing? Let us know and we'll add it if we can.

GPU	$ / FP32 TFLOPs	$ / FP16 TFLOPs	$ / Tensor Core Count	$ / Memory Capacity (GB)	$ / Memory Bandwidth (GB/s)	$ / Int8 TOPs	Minimum Price	Available for Sale
NVIDIA T4 16GB	$73.95 8.1 TFLOPs	$9.22 65 TFLOPs	$1.87 320 Cores	$37.44 16 GB	$1.87 320 GB/s	$4.61 130 TOPs	$599	91
NVIDIA A30 24GB	$13.94 165 TFLOPs	$13.94 165 TFLOPs	$10.27 224 Cores	$95.83 24 GB	$2.46 933.3 GB/s	$6.97 330 TOPs	$2,300	42
NVIDIA A40 48GB	$120.32 37.4 TFLOPs	$120.32 37.4 TFLOPs	$13.39 336 Cores	$93.75 48 GB	$6.47 696 GB/s	$15.04 299.3 TOPs	$4,500	31
NVIDIA A10 24GB	$44.84 31.2 TFLOPs	$11.19 125 TFLOPs	$4.86 288 Cores	$58.29 24 GB	$2.33 600 GB/s	$5.60 250 TOPs	$1,399	68
NVIDIA L40 48GB	$60.22 90.5 TFLOPs	$30.10 181.05 TFLOPs	$9.60 568 Cores	$113.54 48 GB	$6.31 864 GB/s	$15.06 362 TOPs	$5,450	27
AMD Radeon RX 7900 XT 20GB	$11.33 52 TFLOPs	$5.72 103 TFLOPs	$3.51 168 Cores	$29.45 20 GB	$0.74 800 GB/s	$5.72 103 TOPs	$589	90
NVIDIA L4 24GB	$15.63 120 TFLOPs	$7.75 242 TFLOPs	$7.81 240 Cores	$78.13 24 GB	$6.25 300 GB/s	$3.87 485 TOPs	$1,875	52
NVIDIA RTX A5000 24GB	$46.74 27.77 TFLOPs	$46.74 27.77 TFLOPs	$5.07 256 Cores	$54.08 24 GB	$1.69 768 GB/s	$2.92 444.4 TOPs	$1,298	80
NVIDIA A100 PCIe 80GB	$66.99 156 TFLOPs	$33.49 312 TFLOPs	$24.19 432 Cores	$130.63 80 GB	$5.40 1935 GB/s	$16.75 624 TOPs	$10,450	12
NVIDIA Tesla P100 16GB	$10.38 10.6 TFLOPs	$5.19 21.2 TFLOPs	$∞ n/a	$6.87 16 GB	$0.15 732 GB/s	$∞ n/a	$110	99
NVIDIA Geforce RTX 4090 24GB	$26.38 82.6 TFLOPs	$3.30 660.6 TFLOPs	$4.26 512 Cores	$90.79 24 GB	$2.16 1008 GB/s	$1.65 1321.2 TOPs	$2,179	99
NVIDIA Tesla V100 32GB	$77.16 14 TFLOPs	$38.58 28 TFLOPs	$1.69 640 Cores	$33.76 32 GB	$1.20 900 GB/s	$19.29 56 TOPs	$1,080	48
NVIDIA H100 PCIe 80GB	$36.74 756 TFLOPs	$18.36 1513 TFLOPs	$60.91 456 Cores	$347.17 80 GB	$13.62 2039 GB/s	$9.18 3026 TOPs	$27,774	9
AMD Radeon RX 7900 XTX 24GB	$11.80 61 TFLOPs	$5.85 123 TFLOPs	$3.75 192 Cores	$30.00 24 GB	$0.75 960 GB/s	$5.85 123 TOPs	$720	100
NVIDIA L40S 48GB	$39.89 183 TFLOPs	$20.17 362 TFLOPs	$12.85 568 Cores	$152.08 48 GB	$8.45 864 GB/s	$4.98 1466 TOPs	$7,300	30
NVIDIA Tesla V100 16GB	$26.84 14 TFLOPs	$13.42 28 TFLOPs	$0.59 640 Cores	$23.48 16 GB	$0.42 900 GB/s	$6.71 56 TOPs	$376	62
AMD Radeon RX 7700 XT 12GB	$9.86 35 TFLOPs	$4.93 70 TFLOPs	$3.19 108 Cores	$28.75 12 GB	$0.80 432 GB/s	$∞ n/a	$345	63
AMD Radeon RX 7800 XT 16GB	$12.70 37 TFLOPs	$6.35 74 TFLOPs	$3.92 120 Cores	$29.38 16 GB	$0.75 624 GB/s	$∞ n/a	$470	78
AMD Radeon RX 7600 XT 16GB	$13.29 22.57 TFLOPs	$6.65 45.14 TFLOPs	$4.69 64 Cores	$18.75 16 GB	$1.04 288 GB/s	$∞ n/a	$300	21
NVIDIA GeForce RTX 5080 16GB	$9.10 112.6 TFLOPs	$2.28 450.2 TFLOPs	$3.05 336 Cores	$64.06 16 GB	$1.07 960 GB/s	$1.14 900.4 TOPs	$1,025	99
NVIDIA GeForce RTX 5090 32GB	$10.97 209.5 TFLOPs	$2.74 838 TFLOPs	$3.38 680 Cores	$71.84 32 GB	$1.28 1792 GB/s	$1.37 1676 TOPs	$2,299	98
NVIDIA GeForce RTX 5070 Ti 16GB	$7.45 112.6 TFLOPs	$1.86 450.2 TFLOPs	$2.50 336 Cores	$52.44 16 GB	$0.87 960 GB/s	$0.93 900.4 TOPs	$839	98
NVIDIA Geforce RTX 4070 12GB	$7.90 58.2 TFLOPs	$1.97 233.2 TFLOPs	$2.50 184 Cores	$38.33 12 GB	$0.91 504 GB/s	$0.99 466.4 TOPs	$460	92
NVIDIA Geforce RTX 4070 Ti 12GB	$7.22 80.2 TFLOPs	$1.80 320.8 TFLOPs	$2.41 240 Cores	$48.25 12 GB	$1.15 504 GB/s	$0.90 641.4 TOPs	$579	32
NVIDIA Geforce RTX 4080 16GB	$8.73 97.4 TFLOPs	$2.13 398.8 TFLOPs	$2.80 304 Cores	$53.13 16 GB	$1.19 716.8 GB/s	$1.09 779.82 TOPs	$850	98