GPUs Ranked by Cost per Int8 TOPs

Something missing? Let us know and we'll add it if we can.

GPU$ / FP32 TFLOPs $ / FP16 TFLOPs $ / Tensor Core Count $ / Memory Capacity (GB) $ / Memory Bandwidth (GB/s) $ / Int8 TOPs Minimum PriceAvailable for Sale
NVIDIA T4 16GB$74.07$9.23$1.87$37.50$1.87$4.62$60093
NVIDIA A30 24GB$17.33$17.33$12.77$119.17$3.06$8.67$2,86036
NVIDIA A40 48GB$176.59$176.59$19.66$137.59$9.49$22.07$6,60426
NVIDIA A10 24GB$48.08$12.00$5.21$62.50$2.50$6.00$1,50061
NVIDIA L40 48GB$50.94$25.46$8.12$96.04$5.34$12.73$4,61027
AMD Radeon RX 7900 XT 20GB$12.98$6.55$4.02$33.75$0.84$6.55$67571
NVIDIA L4 24GB$17.33$8.59$8.66$86.63$6.93$4.29$2,07929
NVIDIA RTX A5000 24GB$55.46$55.46$6.02$64.17$2.01$3.47$1,54064
NVIDIA A100 PCIe 80GB$104.17$52.08$37.62$203.13$8.40$26.04$16,25011
NVIDIA Tesla P100 16GB$18.40$9.20$โˆž$12.19$0.27$โˆž$19598
NVIDIA Geforce RTX 4090 24GB$27.83$3.48$4.49$95.79$2.28$1.74$2,29991
NVIDIA Tesla V100 32GB$111.05$55.53$2.43$48.59$1.73$27.76$1,55533
NVIDIA H100 PCIe 80GB$38.35$19.16$63.59$362.44$14.22$9.58$28,99512
AMD Radeon RX 7900 XTX 24GB$13.69$6.79$4.35$34.79$0.87$6.79$83594
NVIDIA L40S 48GB$44.72$22.60$14.41$170.48$9.47$5.58$8,18325
NVIDIA Tesla V100 16GB$45.00$22.50$0.98$39.37$0.70$11.25$63045
AMD Radeon RX 7700 XT 12GB$13.28$6.64$4.31$38.75$1.08$โˆž$46536
AMD Radeon RX 7800 XT 16GB$15.13$7.57$4.67$35.00$0.90$โˆž$56056
AMD Radeon RX 7600 XT 16GB$15.51$7.75$5.47$21.87$1.22$โˆž$3505
NVIDIA GeForce RTX 5080 16GB$11.54$2.89$3.87$81.25$1.35$1.44$1,30099
NVIDIA GeForce RTX 5090 32GB$15.03$3.76$4.63$98.38$1.76$1.88$3,14874
NVIDIA GeForce RTX 5070 Ti 16GB$8.79$2.20$2.95$61.87$1.03$1.10$99082
NVIDIA Geforce RTX 4070 12GB$9.04$2.26$2.86$43.83$1.04$1.13$52666
NVIDIA Geforce RTX 4070 Ti 12GB$8.98$2.24$3.00$60.00$1.43$1.12$72046
NVIDIA Geforce RTX 4080 16GB$9.88$2.41$3.16$60.13$1.34$1.23$96277