GPUs Ranked by Cost per Int8 TOPs

Something missing? Let us know and we'll add it if we can.

GPU$ / FP32 TFLOPs $ / FP16 TFLOPs $ / Tensor Core Count $ / Memory Capacity (GB) $ / Memory Bandwidth (GB/s) $ / Int8 TOPs Minimum PriceAvailable for Sale
NVIDIA T4 16GB$71.60$8.92$1.81$36.25$1.81$4.46$58085
NVIDIA A30 24GB$17.88$17.88$13.17$122.92$3.16$8.94$2,95046
NVIDIA A40 48GB$114.97$114.97$12.80$89.58$6.18$14.37$4,30037
NVIDIA A10 24GB$35.26$8.80$3.82$45.83$1.83$4.40$1,10071
NVIDIA L40 48GB$55.19$27.59$8.79$104.06$5.78$13.80$4,99527
AMD Radeon RX 7900 XT 20GB$10.58$5.34$3.27$27.50$0.69$5.34$55090
NVIDIA L4 24GB$14.83$7.36$7.42$74.17$5.93$3.67$1,78053
NVIDIA RTX A5000 24GB$46.78$46.78$5.07$54.13$1.69$2.92$1,29969
NVIDIA A100 PCIe 80GB$62.18$31.09$22.45$121.25$5.01$15.54$9,70012
NVIDIA Tesla P100 16GB$9.24$4.62$โˆž$6.12$0.13$โˆž$98100
NVIDIA Geforce RTX 4090 24GB$0.96$0.12$0.15$3.29$0.08$0.06$79100
NVIDIA Tesla V100 32GB$50.00$25.00$1.09$21.87$0.78$12.50$70061
NVIDIA H100 PCIe 80GB$36.45$18.21$60.42$344.41$13.51$9.11$27,55312
AMD Radeon RX 7900 XTX 24GB$10.58$5.25$3.36$26.88$0.67$5.25$645100
NVIDIA L40S 48GB$38.25$19.34$12.32$145.83$8.10$4.77$7,00034
NVIDIA Tesla V100 16GB$20.00$10.00$0.44$17.50$0.31$5.00$28067
AMD Radeon RX 7700 XT 12GB$8.57$4.29$2.78$25.00$0.69$โˆž$30052
AMD Radeon RX 7800 XT 16GB$10.92$5.46$3.37$25.25$0.65$โˆž$40469
AMD Radeon RX 7600 XT 16GB$13.29$6.65$4.69$18.75$1.04$โˆž$30017
NVIDIA GeForce RTX 5080 16GB$9.10$2.28$3.05$64.06$1.07$1.14$1,025100
NVIDIA GeForce RTX 5090 32GB$11.59$2.90$3.57$75.91$1.36$1.45$2,42998
NVIDIA GeForce RTX 5070 Ti 16GB$6.84$1.71$2.29$48.12$0.80$0.86$770100
NVIDIA Geforce RTX 4070 12GB$7.39$1.84$2.34$35.83$0.85$0.92$43068
NVIDIA Geforce RTX 4070 Ti 12GB$4.99$1.25$1.67$33.33$0.79$0.62$40063
NVIDIA Geforce RTX 4080 16GB$7.80$1.91$2.50$47.50$1.06$0.97$76099