GPUs Ranked by Cost per Int8 TOPs

Something missing? Let us know and we'll add it if we can.

GPU$ / FP32 TFLOPs $ / FP16 TFLOPs $ / Tensor Core Count $ / Memory Capacity (GB) $ / Memory Bandwidth (GB/s) $ / Int8 TOPs Minimum PriceAvailable for Sale
NVIDIA T4 16GB$67.90$8.46$1.72$34.37$1.72$4.23$55091
NVIDIA A30 24GB$16.36$16.36$12.05$112.46$2.89$8.18$2,69934
NVIDIA A40 48GB$181.82$181.82$20.24$141.67$9.77$22.72$6,80027
NVIDIA A10 24GB$41.63$10.39$4.51$54.13$2.17$5.20$1,29964
NVIDIA L40 48GB$54.97$27.48$8.76$103.65$5.76$13.74$4,97518
AMD Radeon RX 7900 XT 20GB$12.79$6.46$3.96$33.25$0.83$6.46$66571
NVIDIA L4 24GB$17.32$8.59$8.66$86.58$6.93$4.28$2,07833
NVIDIA RTX A5000 24GB$46.78$46.78$5.07$54.13$1.69$2.92$1,29975
NVIDIA A100 PCIe 80GB$102.56$51.28$37.03$199.99$8.27$25.64$15,99912
NVIDIA Tesla P100 16GB$16.51$8.25$โˆž$10.94$0.24$โˆž$175100
NVIDIA Geforce RTX 4090 24GB$26.03$3.25$4.20$89.58$2.13$1.63$2,150100
NVIDIA Tesla V100 32GB$121.43$60.71$2.66$53.12$1.89$30.36$1,70027
NVIDIA H100 PCIe 80GB$38.35$19.16$63.59$362.44$14.22$9.58$28,99512
AMD Radeon RX 7900 XTX 24GB$13.52$6.71$4.30$34.38$0.86$6.71$825100
NVIDIA L40S 48GB$44.72$22.60$14.41$170.48$9.47$5.58$8,18325
NVIDIA Tesla V100 16GB$32.14$16.07$0.70$28.13$0.50$8.04$45053
AMD Radeon RX 7700 XT 12GB$12.86$6.43$4.17$37.50$1.04$โˆž$45039
AMD Radeon RX 7800 XT 16GB$14.78$7.39$4.56$34.18$0.88$โˆž$54757
AMD Radeon RX 7600 XT 16GB$14.18$7.09$5.00$20.00$1.11$โˆž$3209
NVIDIA GeForce RTX 5080 16GB$10.66$2.67$3.57$75.00$1.25$1.33$1,200100
NVIDIA GeForce RTX 5090 32GB$14.02$3.50$4.32$91.78$1.64$1.75$2,937100
NVIDIA GeForce RTX 5070 Ti 16GB$7.55$1.89$2.53$53.13$0.89$0.94$85099
NVIDIA Geforce RTX 4070 12GB$9.11$2.27$2.88$44.17$1.05$1.14$53068
NVIDIA Geforce RTX 4070 Ti 12GB$8.35$2.09$2.79$55.83$1.33$1.04$67045
NVIDIA Geforce RTX 4080 16GB$9.52$2.32$3.05$57.95$1.29$1.19$92784