GPUs Ranked by Cost per Int8 TOPs

Something missing? Let us know and we'll add it if we can.

GPU$ / FP32 TFLOPs $ / FP16 TFLOPs $ / Tensor Core Count $ / Memory Capacity (GB) $ / Memory Bandwidth (GB/s) $ / Int8 TOPs Minimum PriceAvailable for Sale
NVIDIA T4 16GB$64.20$8.00$1.63$32.50$1.63$4.00$52085
NVIDIA A30 24GB$14.55$14.55$10.71$100.00$2.57$7.27$2,40034
NVIDIA A40 48GB$160.43$160.43$17.86$125.00$8.62$20.05$6,00027
NVIDIA A10 24GB$41.63$10.39$4.51$54.13$2.17$5.20$1,29966
NVIDIA L40 48GB$49.72$24.85$7.92$93.75$5.21$12.43$4,50028
AMD Radeon RX 7900 XT 20GB$12.48$6.30$3.86$32.45$0.81$6.30$64978
NVIDIA L4 24GB$17.27$8.56$8.63$86.33$6.91$4.27$2,07247
NVIDIA RTX A5000 24GB$55.82$55.82$6.05$64.58$2.02$3.49$1,55072
NVIDIA A100 PCIe 80GB$76.92$38.46$27.78$149.99$6.20$19.23$11,99911
NVIDIA Tesla P100 16GB$14.15$7.07$โˆž$9.37$0.20$โˆž$150100
NVIDIA Geforce RTX 4090 24GB$25.73$3.22$4.15$88.54$2.11$1.61$2,12599
NVIDIA Tesla V100 32GB$114.29$57.14$2.50$50.00$1.78$28.57$1,60038
NVIDIA H100 PCIe 80GB$33.07$16.52$54.82$312.49$12.26$8.26$24,9998
AMD Radeon RX 7900 XTX 24GB$11.48$5.69$3.65$29.17$0.73$5.69$700100
NVIDIA L40S 48GB$44.72$22.60$14.41$170.48$9.47$5.58$8,18325
NVIDIA Tesla V100 16GB$30.36$15.18$0.66$26.56$0.47$7.59$42558
AMD Radeon RX 7700 XT 12GB$11.43$5.71$3.70$33.33$0.93$โˆž$40050
AMD Radeon RX 7800 XT 16GB$13.25$6.63$4.09$30.65$0.79$โˆž$49064
AMD Radeon RX 7600 XT 16GB$17.72$8.86$6.25$25.00$1.39$โˆž$40010
NVIDIA GeForce RTX 5080 16GB$10.92$2.73$3.66$76.87$1.28$1.37$1,230100
NVIDIA GeForce RTX 5090 32GB$12.39$3.10$3.82$81.13$1.45$1.55$2,59698
NVIDIA GeForce RTX 5070 Ti 16GB$7.50$1.88$2.51$52.78$0.88$0.94$845100
NVIDIA Geforce RTX 4070 12GB$8.85$2.21$2.80$42.92$1.02$1.10$51575
NVIDIA Geforce RTX 4070 Ti 12GB$8.48$2.12$2.83$56.67$1.35$1.06$68052
NVIDIA Geforce RTX 4080 16GB$8.98$2.19$2.88$54.69$1.22$1.12$87596