GPUs Ranked by Cost per FP32 TFLOPs

Something missing? Let us know and we'll add it if we can.

GPU	$ / FP32 TFLOPs	$ / FP16 TFLOPs	$ / Tensor Core Count	$ / Memory Capacity (GB)	$ / Memory Bandwidth (GB/s)	$ / Int8 TOPs	Minimum Price	Available for Sale
NVIDIA T4 16GB	$80.12 8.1 TFLOPs	$9.98 65 TFLOPs	$2.03 320 Cores	$40.56 16 GB	$2.03 320 GB/s	$4.99 130 TOPs	$649	84
NVIDIA A30 24GB	$13.94 165 TFLOPs	$13.94 165 TFLOPs	$10.27 224 Cores	$95.83 24 GB	$2.46 933.3 GB/s	$6.97 330 TOPs	$2,300	46
NVIDIA A40 48GB	$120.32 37.4 TFLOPs	$120.32 37.4 TFLOPs	$13.39 336 Cores	$93.75 48 GB	$6.47 696 GB/s	$15.04 299.3 TOPs	$4,500	28
NVIDIA A10 24GB	$49.30 31.2 TFLOPs	$12.31 125 TFLOPs	$5.34 288 Cores	$64.09 24 GB	$2.56 600 GB/s	$6.15 250 TOPs	$1,538	63
NVIDIA L40 48GB	$58.51 90.5 TFLOPs	$29.25 181.05 TFLOPs	$9.32 568 Cores	$110.31 48 GB	$6.13 864 GB/s	$14.63 362 TOPs	$5,295	28
AMD Radeon RX 7900 XT 20GB	$11.15 52 TFLOPs	$5.63 103 TFLOPs	$3.45 168 Cores	$29.00 20 GB	$0.73 800 GB/s	$5.63 103 TOPs	$580	93
NVIDIA L4 24GB	$15.83 120 TFLOPs	$7.85 242 TFLOPs	$7.91 240 Cores	$79.13 24 GB	$6.33 300 GB/s	$3.92 485 TOPs	$1,899	55
NVIDIA RTX A5000 24GB	$46.45 27.77 TFLOPs	$46.45 27.77 TFLOPs	$5.04 256 Cores	$53.75 24 GB	$1.68 768 GB/s	$2.90 444.4 TOPs	$1,290	87
NVIDIA A100 PCIe 80GB	$73.72 156 TFLOPs	$36.86 312 TFLOPs	$26.62 432 Cores	$143.75 80 GB	$5.94 1935 GB/s	$18.43 624 TOPs	$11,500	12
NVIDIA Tesla P100 16GB	$12.07 10.6 TFLOPs	$6.04 21.2 TFLOPs	$∞ n/a	$8.00 16 GB	$0.17 732 GB/s	$∞ n/a	$128	100
NVIDIA Geforce RTX 4090 24GB	$26.63 82.6 TFLOPs	$3.33 660.6 TFLOPs	$4.30 512 Cores	$91.67 24 GB	$2.18 1008 GB/s	$1.67 1321.2 TOPs	$2,200	99
NVIDIA Tesla V100 32GB	$77.72 14 TFLOPs	$38.86 28 TFLOPs	$1.70 640 Cores	$34.00 32 GB	$1.21 900 GB/s	$19.43 56 TOPs	$1,088	43
NVIDIA H100 PCIe 80GB	$36.88 756 TFLOPs	$18.43 1513 TFLOPs	$61.14 456 Cores	$348.50 80 GB	$13.67 2039 GB/s	$9.21 3026 TOPs	$27,880	9
AMD Radeon RX 7900 XTX 24GB	$12.30 61 TFLOPs	$6.10 123 TFLOPs	$3.91 192 Cores	$31.25 24 GB	$0.78 960 GB/s	$6.10 123 TOPs	$750	100
NVIDIA L40S 48GB	$43.58 183 TFLOPs	$22.03 362 TFLOPs	$14.04 568 Cores	$166.15 48 GB	$9.23 864 GB/s	$5.44 1466 TOPs	$7,975	28
NVIDIA Tesla V100 16GB	$29.29 14 TFLOPs	$14.64 28 TFLOPs	$0.64 640 Cores	$25.63 16 GB	$0.46 900 GB/s	$7.32 56 TOPs	$410	63
AMD Radeon RX 7700 XT 12GB	$10.43 35 TFLOPs	$5.21 70 TFLOPs	$3.38 108 Cores	$30.42 12 GB	$0.84 432 GB/s	$∞ n/a	$365	66
AMD Radeon RX 7800 XT 16GB	$12.70 37 TFLOPs	$6.35 74 TFLOPs	$3.92 120 Cores	$29.38 16 GB	$0.75 624 GB/s	$∞ n/a	$470	83
AMD Radeon RX 7600 XT 16GB	$14.40 22.57 TFLOPs	$7.20 45.14 TFLOPs	$5.08 64 Cores	$20.31 16 GB	$1.13 288 GB/s	$∞ n/a	$325	17
NVIDIA GeForce RTX 5080 16GB	$10.90 112.6 TFLOPs	$2.73 450.2 TFLOPs	$3.65 336 Cores	$76.72 16 GB	$1.28 960 GB/s	$1.36 900.4 TOPs	$1,228	99
NVIDIA GeForce RTX 5090 32GB	$11.88 209.5 TFLOPs	$2.97 838 TFLOPs	$3.66 680 Cores	$77.78 32 GB	$1.39 1792 GB/s	$1.49 1676 TOPs	$2,489	100
NVIDIA GeForce RTX 5070 Ti 16GB	$7.37 112.6 TFLOPs	$1.84 450.2 TFLOPs	$2.47 336 Cores	$51.87 16 GB	$0.86 960 GB/s	$0.92 900.4 TOPs	$830	99
NVIDIA Geforce RTX 4070 12GB	$8.25 58.2 TFLOPs	$2.06 233.2 TFLOPs	$2.61 184 Cores	$40.00 12 GB	$0.95 504 GB/s	$1.03 466.4 TOPs	$480	100
NVIDIA Geforce RTX 4070 Ti 12GB	$9.03 80.2 TFLOPs	$2.26 320.8 TFLOPs	$3.02 240 Cores	$60.38 12 GB	$1.44 504 GB/s	$1.13 641.4 TOPs	$725	32
NVIDIA Geforce RTX 4080 16GB	$9.03 97.4 TFLOPs	$2.21 398.8 TFLOPs	$2.89 304 Cores	$55.00 16 GB	$1.23 716.8 GB/s	$1.13 779.82 TOPs	$880	100