GPUs Ranked by Cost per Memory Bandwidth (GB/s)

Something missing? Let us know and we'll add it if we can.

GPU$ / FP32 TFLOPs $ / FP16 TFLOPs $ / Tensor Core Count $ / Memory Capacity (GB) $ / Memory Bandwidth (GB/s) $ / Int8 TOPs Minimum PriceAvailable for Sale
NVIDIA T4 16GB$74.07$9.23$1.88$37.50$1.88$4.62$60078
NVIDIA A30 24GB$20.91$20.91$15.40$143.75$3.70$10.45$3,45035
NVIDIA A40 48GB$140.37$140.37$15.63$109.38$7.54$17.54$5,25027
NVIDIA A10 24GB$48.08$12.00$5.21$62.50$2.50$6.00$1,50061
NVIDIA L40 48GB$60.77$30.38$9.68$114.58$6.37$15.19$5,50054
AMD Radeon RX 7900 XT 20GB$11.35$5.73$3.51$29.50$0.74$5.73$590100
NVIDIA L4 24GB$15.83$7.85$7.91$79.13$6.33$3.92$1,89954
NVIDIA RTX A5000 24GB$48.97$48.97$5.31$56.67$1.77$3.06$1,36083
NVIDIA A100 PCIe 80GB$73.72$36.86$26.62$143.75$5.94$18.43$11,50012
NVIDIA Tesla P100 16GB$13.02$6.51$โˆž$8.62$0.19$โˆž$138100
NVIDIA Geforce RTX 4090 24GB$27.24$3.41$4.39$93.75$2.23$1.70$2,250100
NVIDIA Tesla V100 32GB$99.14$49.57$2.17$43.38$1.54$24.79$1,38842
NVIDIA H100 PCIe 80GB$34.39$17.18$57.02$325.00$12.75$8.59$26,00010
AMD Radeon RX 7900 XTX 24GB$12.95$6.42$4.11$32.92$0.82$6.42$790100
NVIDIA L40S 48GBn/an/an/an/an/an/an/a0
NVIDIA Tesla V100 16GB$32.14$16.07$0.70$28.12$0.50$8.04$45061
AMD Radeon RX 7700 XT 12GB$11.09$5.54$3.59$32.33$0.90$โˆž$38859
AMD Radeon RX 7800 XT 16GB$12.84$6.42$3.96$29.69$0.76$โˆž$47576
AMD Radeon RX 7600 XT 16GB$16.35$8.17$5.77$23.06$1.28$โˆž$36915
NVIDIA GeForce RTX 5080 16GB$10.57$2.64$3.54$74.37$1.24$1.32$1,190100
NVIDIA GeForce RTX 5090 32GB$12.41$3.10$3.82$81.22$1.45$1.55$2,599100
NVIDIA GeForce RTX 5070 Ti 16GB$7.36$1.84$2.47$51.81$0.86$0.92$829100
NVIDIA Geforce RTX 4070 12GB$8.16$2.04$2.58$39.58$0.94$1.02$475100
NVIDIA Geforce RTX 4070 Ti 12GB$11.22$2.81$3.75$75.00$1.79$1.40$90021
NVIDIA Geforce RTX 4080 16GB$9.02$2.20$2.89$54.94$1.23$1.13$87998