GPUs Ranked by Cost per Memory Bandwidth (GB/s)

Something missing? Let us know and we'll add it if we can.

GPU$ / FP32 TFLOPs $ / FP16 TFLOPs $ / Tensor Core Count $ / Memory Capacity (GB) $ / Memory Bandwidth (GB/s) $ / Int8 TOPs Minimum PriceAvailable for Sale
NVIDIA T4 16GB$72.84$9.08$1.84$36.88$1.84$4.54$59088
NVIDIA A30 24GB$19.03$19.03$14.02$130.83$3.36$9.52$3,14034
NVIDIA A40 48GB$177.79$177.79$19.79$138.53$9.55$22.22$6,64923
NVIDIA A10 24GB$54.78$13.67$5.93$71.21$2.85$6.84$1,70959
NVIDIA L40 48GB$63.54$31.76$10.12$119.79$6.66$15.88$5,75029
AMD Radeon RX 7900 XT 20GB$13.44$6.79$4.16$34.95$0.87$6.79$69976
NVIDIA L4 24GB$16.66$8.26$8.33$83.32$6.67$4.12$2,00035
NVIDIA RTX A5000 24GB$46.81$46.81$5.08$54.16$1.69$2.93$1,30065
NVIDIA A100 PCIe 80GB$104.17$52.08$37.62$203.13$8.40$26.04$16,25012
NVIDIA Tesla P100 16GB$17.45$8.73$โˆž$11.56$0.25$โˆž$18599
NVIDIA Geforce RTX 4090 24GB$29.00$3.63$4.68$99.79$2.38$1.81$2,39594
NVIDIA Tesla V100 32GB$128.57$64.29$2.81$56.25$2.00$32.14$1,80035
NVIDIA H100 PCIe 80GB$36.70$18.34$60.85$346.82$13.61$9.17$27,74515
AMD Radeon RX 7900 XTX 24GB$14.75$7.32$4.69$37.50$0.94$7.32$90086
NVIDIA L40S 48GB$44.72$22.60$14.41$170.48$9.47$5.58$8,18325
NVIDIA Tesla V100 16GB$42.86$21.43$0.94$37.50$0.67$10.71$60043
AMD Radeon RX 7700 XT 12GB$12.86$6.43$4.17$37.50$1.04$โˆž$45043
AMD Radeon RX 7800 XT 16GB$16.22$8.11$5.00$37.50$0.96$โˆž$60057
AMD Radeon RX 7600 XT 16GB$17.72$8.86$6.25$25.00$1.39$โˆž$4009
NVIDIA GeForce RTX 5080 16GB$12.88$3.22$4.32$90.62$1.51$1.61$1,450100
NVIDIA GeForce RTX 5090 32GB$16.22$4.05$5.00$106.19$1.90$2.03$3,39874
NVIDIA GeForce RTX 5070 Ti 16GB$8.97$2.24$3.01$63.12$1.05$1.12$1,01082
NVIDIA Geforce RTX 4070 12GB$9.88$2.47$3.13$47.92$1.14$1.23$57564
NVIDIA Geforce RTX 4070 Ti 12GB$8.73$2.18$2.92$58.33$1.39$1.09$70037
NVIDIA Geforce RTX 4080 16GB$10.77$2.63$3.45$65.56$1.46$1.35$1,04968