GPUs Ranked by Cost per Memory Bandwidth (GB/s)

Something missing? Let us know and we'll add it if we can.

GPU$ / FP32 TFLOPs $ / FP16 TFLOPs $ / Tensor Core Count $ / Memory Capacity (GB) $ / Memory Bandwidth (GB/s) $ / Int8 TOPs Minimum PriceAvailable for Sale
NVIDIA T4 16GB$72.22$9.00$1.83$36.56$1.83$4.50$58585
NVIDIA A30 24GB$15.15$15.15$11.16$104.13$2.68$7.57$2,49940
NVIDIA A40 48GB$133.66$133.66$14.88$104.15$7.18$16.70$4,99928
NVIDIA A10 24GB$43.27$10.80$4.69$56.25$2.25$5.40$1,35065
NVIDIA L40 48GB$60.22$30.10$9.60$113.54$6.31$15.06$5,45027
AMD Radeon RX 7900 XT 20GB$11.06$5.58$3.42$28.75$0.72$5.58$57596
NVIDIA L4 24GB$15.83$7.85$7.91$79.13$6.33$3.92$1,89954
NVIDIA RTX A5000 24GB$48.61$48.61$5.27$56.25$1.76$3.04$1,35085
NVIDIA A100 PCIe 80GB$73.72$36.86$26.62$143.75$5.94$18.43$11,50010
NVIDIA Tesla P100 16GB$12.07$6.04$โˆž$8.00$0.17$โˆž$12899
NVIDIA Geforce RTX 4090 24GB$27.84$3.48$4.49$95.83$2.28$1.74$2,30090
NVIDIA Tesla V100 32GB$77.81$38.90$1.70$34.04$1.21$19.45$1,08944
NVIDIA H100 PCIe 80GB$36.92$18.45$61.21$348.91$13.69$9.22$27,91310
AMD Radeon RX 7900 XTX 24GB$11.48$5.69$3.65$29.17$0.73$5.69$700100
NVIDIA L40S 48GB$43.58$22.03$14.04$166.15$9.23$5.44$7,97529
NVIDIA Tesla V100 16GB$29.29$14.64$0.64$25.63$0.46$7.32$41062
AMD Radeon RX 7700 XT 12GB$10.43$5.21$3.38$30.42$0.84$โˆž$36562
AMD Radeon RX 7800 XT 16GB$10.81$5.41$3.33$25.00$0.64$โˆž$40089
AMD Radeon RX 7600 XT 16GB$13.96$6.98$4.92$19.69$1.09$โˆž$31514
NVIDIA GeForce RTX 5080 16GB$10.21$2.55$3.42$71.88$1.20$1.28$1,15099
NVIDIA GeForce RTX 5090 32GB$11.04$2.76$3.40$72.29$1.29$1.38$2,313100
NVIDIA GeForce RTX 5070 Ti 16GB$6.57$1.64$2.20$46.25$0.77$0.82$74098
NVIDIA Geforce RTX 4070 12GB$8.16$2.04$2.58$39.58$0.94$1.02$47594
NVIDIA Geforce RTX 4070 Ti 12GB$8.18$2.04$2.73$54.64$1.30$1.02$65632
NVIDIA Geforce RTX 4080 16GB$9.23$2.25$2.96$56.19$1.25$1.15$89997