GPUs Ranked by Cost per Memory Capacity (GB)

Something missing? Let us know and we'll add it if we can.

GPU	$ / FP32 TFLOPs	$ / FP16 TFLOPs	$ / Tensor Core Count	$ / Memory Capacity (GB)	$ / Memory Bandwidth (GB/s)	$ / Int8 TOPs	Minimum Price	Available for Sale
NVIDIA T4 16GB	$70.37 8.1 TFLOPs	$8.77 65 TFLOPs	$1.78 320 Cores	$35.62 16 GB	$1.78 320 GB/s	$4.38 130 TOPs	$570	92
NVIDIA A30 24GB	$15.15 165 TFLOPs	$15.15 165 TFLOPs	$11.16 224 Cores	$104.17 24 GB	$2.68 933.3 GB/s	$7.58 330 TOPs	$2,500	35
NVIDIA A40 48GB	$181.82 37.4 TFLOPs	$181.82 37.4 TFLOPs	$20.24 336 Cores	$141.67 48 GB	$9.77 696 GB/s	$22.72 299.3 TOPs	$6,800	27
NVIDIA A10 24GB	$41.63 31.2 TFLOPs	$10.39 125 TFLOPs	$4.51 288 Cores	$54.13 24 GB	$2.17 600 GB/s	$5.20 250 TOPs	$1,299	65
NVIDIA L40 48GB	$52.49 90.5 TFLOPs	$26.24 181.05 TFLOPs	$8.36 568 Cores	$98.96 48 GB	$5.50 864 GB/s	$13.12 362 TOPs	$4,750	51
AMD Radeon RX 7900 XT 20GB	$12.50 52 TFLOPs	$6.31 103 TFLOPs	$3.87 168 Cores	$32.50 20 GB	$0.81 800 GB/s	$6.31 103 TOPs	$650	72
NVIDIA L4 24GB	$17.32 120 TFLOPs	$8.59 242 TFLOPs	$8.66 240 Cores	$86.58 24 GB	$6.93 300 GB/s	$4.28 485 TOPs	$2,078	39
NVIDIA RTX A5000 24GB	$43.21 27.77 TFLOPs	$43.21 27.77 TFLOPs	$4.69 256 Cores	$50.00 24 GB	$1.56 768 GB/s	$2.70 444.4 TOPs	$1,200	77
NVIDIA A100 PCIe 80GB	$102.56 156 TFLOPs	$51.28 312 TFLOPs	$37.03 432 Cores	$199.99 80 GB	$8.27 1935 GB/s	$25.64 624 TOPs	$15,999	11
NVIDIA Tesla P100 16GB	$16.51 10.6 TFLOPs	$8.25 21.2 TFLOPs	$∞ n/a	$10.94 16 GB	$0.24 732 GB/s	$∞ n/a	$175	100
NVIDIA Geforce RTX 4090 24GB	$26.03 82.6 TFLOPs	$3.25 660.6 TFLOPs	$4.20 512 Cores	$89.58 24 GB	$2.13 1008 GB/s	$1.63 1321.2 TOPs	$2,150	100
NVIDIA Tesla V100 32GB	$100.00 14 TFLOPs	$50.00 28 TFLOPs	$2.19 640 Cores	$43.75 32 GB	$1.56 900 GB/s	$25.00 56 TOPs	$1,400	26
NVIDIA H100 PCIe 80GB	$38.96 756 TFLOPs	$19.46 1513 TFLOPs	$64.58 456 Cores	$368.13 80 GB	$14.44 2039 GB/s	$9.73 3026 TOPs	$29,450	8
AMD Radeon RX 7900 XTX 24GB	$13.93 61 TFLOPs	$6.91 123 TFLOPs	$4.43 192 Cores	$35.42 24 GB	$0.89 960 GB/s	$6.91 123 TOPs	$850	100
NVIDIA L40S 48GB	n/a 183 TFLOPs	n/a 362 TFLOPs	n/a 568 Cores	n/a 48 GB	n/a 864 GB/s	n/a 1466 TOPs	n/a	0
NVIDIA Tesla V100 16GB	$35.71 14 TFLOPs	$17.86 28 TFLOPs	$0.78 640 Cores	$31.25 16 GB	$0.56 900 GB/s	$8.93 56 TOPs	$500	54
AMD Radeon RX 7700 XT 12GB	$12.86 35 TFLOPs	$6.43 70 TFLOPs	$4.17 108 Cores	$37.50 12 GB	$1.04 432 GB/s	$∞ n/a	$450	43
AMD Radeon RX 7800 XT 16GB	$14.32 37 TFLOPs	$7.16 74 TFLOPs	$4.42 120 Cores	$33.13 16 GB	$0.85 624 GB/s	$∞ n/a	$530	59
AMD Radeon RX 7600 XT 16GB	$19.05 22.57 TFLOPs	$9.53 45.14 TFLOPs	$6.72 64 Cores	$26.87 16 GB	$1.49 288 GB/s	$∞ n/a	$430	10
NVIDIA GeForce RTX 5080 16GB	$10.66 112.6 TFLOPs	$2.67 450.2 TFLOPs	$3.57 336 Cores	$75.00 16 GB	$1.25 960 GB/s	$1.33 900.4 TOPs	$1,200	98
NVIDIA GeForce RTX 5090 32GB	$13.26 209.5 TFLOPs	$3.32 838 TFLOPs	$4.09 680 Cores	$86.83 32 GB	$1.55 1792 GB/s	$1.66 1676 TOPs	$2,779	100
NVIDIA GeForce RTX 5070 Ti 16GB	$7.99 112.6 TFLOPs	$2.00 450.2 TFLOPs	$2.68 336 Cores	$56.25 16 GB	$0.94 960 GB/s	$1.00 900.4 TOPs	$900	100
NVIDIA Geforce RTX 4070 12GB	$8.59 58.2 TFLOPs	$2.14 233.2 TFLOPs	$2.72 184 Cores	$41.67 12 GB	$0.99 504 GB/s	$1.07 466.4 TOPs	$500	68
NVIDIA Geforce RTX 4070 Ti 12GB	$8.23 80.2 TFLOPs	$2.06 320.8 TFLOPs	$2.75 240 Cores	$55.00 12 GB	$1.31 504 GB/s	$1.03 641.4 TOPs	$660	42
NVIDIA Geforce RTX 4080 16GB	$9.24 97.4 TFLOPs	$2.26 398.8 TFLOPs	$2.96 304 Cores	$56.25 16 GB	$1.26 716.8 GB/s	$1.15 779.82 TOPs	$900	92