GPUs Ranked by Cost per Memory Capacity (GB)

Something missing? Let us know and we'll add it if we can.

GPU$ / FP32 TFLOPs $ / FP16 TFLOPs $ / Tensor Core Count $ / Memory Capacity (GB) $ / Memory Bandwidth (GB/s) $ / Int8 TOPs Minimum PriceAvailable for Sale
NVIDIA T4 16GB$73.95$9.22$1.87$37.44$1.87$4.61$59969
NVIDIA A30 24GB$17.88$17.88$13.17$122.92$3.16$8.94$2,95033
NVIDIA A40 48GB$133.56$133.56$14.87$104.06$7.18$16.69$4,99529
NVIDIA A10 24GB$63.30$15.80$6.86$82.29$3.29$7.90$1,97559
NVIDIA L40 48GB$57.18$28.58$9.11$107.81$5.99$14.30$5,17531
AMD Radeon RX 7900 XT 20GB$15.38$7.77$4.76$40.00$1.00$7.77$80037
NVIDIA L4 24GB$16.99$8.43$8.50$84.96$6.80$4.20$2,03925
NVIDIA RTX A5000 24GB$47.89$47.89$5.20$55.42$1.73$2.99$1,33063
NVIDIA A100 PCIe 80GB$115.38$57.69$41.66$224.99$9.30$28.84$17,99912
NVIDIA Tesla P100 16GB$22.17$11.08$โˆž$14.69$0.32$โˆž$23588
NVIDIA RTX 4090 24GB$29.04$7.26$4.69$99.96$2.38$3.63$2,39993
NVIDIA Tesla V100 32GB$114.29$57.14$2.50$50.00$1.78$28.57$1,60035
NVIDIA H100 PCIe 80GB$29.76$14.87$49.34$281.25$11.03$7.44$22,50012
AMD Radeon RX 7900 XTX 24GB$19.23$9.54$6.11$48.88$1.22$9.54$1,17351
NVIDIA L40S 48GB$40.98$20.72$13.20$156.25$8.68$5.12$7,50033
NVIDIA Tesla V100 16GB$45.71$22.86$1.00$40.00$0.71$11.43$64044
AMD Radeon RX 7700 XT 12GB$16.26$8.13$5.27$47.42$1.32$โˆž$56929
AMD Radeon RX 7800 XT 16GB$17.15$8.58$5.29$39.66$1.02$โˆž$63546
AMD Radeon RX 7600 XT 16GB$17.28$8.64$6.09$24.37$1.35$โˆž$39012