GPUs Ranked by Cost per Int8 TOPs

Something missing? Let us know and we'll add it if we can.

GPU$ / Tensor Core Count $ / FP32 TFLOPs $ / FP16 TFLOPs $ / Int8 TOPs $ / Memory Capacity (GB) $ / Memory Bandwidth (GB/s) Minimum PriceAvailable for Sale
NVIDIA T4 16GB$1.82$71.85$8.95$4.48$36.38$1.82$58277
NVIDIA A30 24GB$3.21$4.36$4.36$2.18$30.00$0.77$72039
NVIDIA A40 48GB$14.58$131.02$131.02$16.37$102.08$7.04$4,90033
NVIDIA A10 24GB$6.07$56.06$13.99$7.00$72.88$2.92$1,74951
NVIDIA L40 48GB$8.80$55.25$27.62$13.81$104.17$5.79$5,00037
AMD Radeon RX 7900 XT 20GB$3.57$11.54$5.83$5.83$30.00$0.75$60048
NVIDIA L4 24GB$7.50$14.99$7.43$3.71$74.96$6.00$1,79928
NVIDIA RTX A5000 24GB$5.55$51.13$51.13$3.20$59.16$1.85$1,42063
NVIDIA A100 PCIe 80GB$45.14$125.00$62.50$31.25$243.75$10.08$19,5009
NVIDIA Tesla P100 16GB$โˆž$16.00$8.00$โˆž$10.60$0.23$17079
NVIDIA RTX 4090 24GB$1.74$10.77$2.69$1.35$37.08$0.88$89096
NVIDIA Tesla V100 32GB$1.56$71.43$35.71$17.86$31.25$1.11$1,00046
AMD Radeon RX 7900 XTX 24GB$4.01$12.62$6.26$6.26$32.08$0.80$77066
NVIDIA H100 PCIe 80GB$55.48$33.47$16.72$8.36$316.25$12.41$25,30012
NVIDIA L40S 48GB$14.96$46.44$23.48$5.80$177.06$9.84$8,49911
NVIDIA Tesla V100 16GB$1.01$46.36$23.18$11.59$40.56$0.72$64953
AMD Radeon RX 7800 XT 16GB$3.63$11.76$5.88$โˆž$27.19$0.70$43554
AMD Radeon RX 7700 XT 12GB$3.80$11.71$5.86$โˆž$34.17$0.95$41034
AMD Radeon RX 7600 XT 16GB$5.16$14.62$7.31$โˆž$20.62$1.15$33020