GPUs Ranked by Cost per Int8 TOPs

Something missing? Let us know and we'll add it if we can.

GPU$ / FP32 TFLOPs $ / FP16 TFLOPs $ / Tensor Core Count $ / Memory Capacity (GB) $ / Memory Bandwidth (GB/s) $ / Int8 TOPs Minimum PriceAvailable for Sale
NVIDIA T4 16GB$73.95$9.22$1.87$37.44$1.87$4.61$59984
NVIDIA A30 24GB$13.94$13.94$10.27$95.83$2.46$6.97$2,30046
NVIDIA A40 48GB$120.32$120.32$13.39$93.75$6.47$15.04$4,50028
NVIDIA A10 24GB$49.30$12.31$5.34$64.09$2.56$6.15$1,53863
NVIDIA L40 48GB$58.51$29.25$9.32$110.31$6.13$14.63$5,29528
AMD Radeon RX 7900 XT 20GB$11.52$5.82$3.57$29.95$0.75$5.82$59995
NVIDIA L4 24GB$15.83$7.85$7.91$79.13$6.33$3.92$1,89955
NVIDIA RTX A5000 24GB$46.45$46.45$5.04$53.75$1.68$2.90$1,29088
NVIDIA A100 PCIe 80GB$73.72$36.86$26.62$143.75$5.94$18.43$11,50012
NVIDIA Tesla P100 16GB$12.07$6.04$โˆž$8.00$0.17$โˆž$128100
NVIDIA Geforce RTX 4090 24GB$27.12$3.39$4.37$93.33$2.22$1.70$2,24092
NVIDIA Tesla V100 32GB$77.72$38.86$1.70$34.00$1.21$19.43$1,08842
NVIDIA H100 PCIe 80GB$36.88$18.43$61.14$348.50$13.67$9.21$27,8809
AMD Radeon RX 7900 XTX 24GB$11.48$5.69$3.65$29.17$0.73$5.69$700100
NVIDIA L40S 48GB$43.58$22.03$14.04$166.15$9.23$5.44$7,97528
NVIDIA Tesla V100 16GB$29.29$14.64$0.64$25.63$0.46$7.32$41062
AMD Radeon RX 7700 XT 12GB$10.43$5.21$3.38$30.42$0.84$โˆž$36567
AMD Radeon RX 7800 XT 16GB$12.16$6.08$3.75$28.13$0.72$โˆž$45084
AMD Radeon RX 7600 XT 16GB$14.40$7.20$5.08$20.31$1.13$โˆž$32515
NVIDIA GeForce RTX 5080 16GB$10.90$2.73$3.65$76.72$1.28$1.36$1,22899
NVIDIA GeForce RTX 5090 32GB$11.88$2.97$3.66$77.78$1.39$1.49$2,48996
NVIDIA GeForce RTX 5070 Ti 16GB$7.37$1.84$2.47$51.87$0.86$0.92$830100
NVIDIA Geforce RTX 4070 12GB$8.25$2.06$2.61$40.00$0.95$1.03$48099
NVIDIA Geforce RTX 4070 Ti 12GB$9.03$2.26$3.02$60.38$1.44$1.13$72532
NVIDIA Geforce RTX 4080 16GB$9.23$2.25$2.96$56.19$1.25$1.15$89997