GPUs Ranked by Cost per Tensor Core Count

Something missing? Let us know and we'll add it if we can.

GPU$ / FP32 TFLOPs $ / FP16 TFLOPs $ / Tensor Core Count $ / Memory Capacity (GB) $ / Memory Bandwidth (GB/s) $ / Int8 TOPs Minimum PriceAvailable for Sale
NVIDIA T4 16GB$64.20$8.00$1.63$32.50$1.63$4.00$52085
NVIDIA A30 24GB$14.55$14.55$10.71$100.00$2.57$7.27$2,40033
NVIDIA A40 48GB$160.43$160.43$17.86$125.00$8.62$20.05$6,00028
NVIDIA A10 24GB$41.63$10.39$4.51$54.13$2.17$5.20$1,29967
NVIDIA L40 48GB$49.72$24.85$7.92$93.75$5.21$12.43$4,50028
AMD Radeon RX 7900 XT 20GB$12.50$6.31$3.87$32.50$0.81$6.31$65075
NVIDIA L4 24GB$17.27$8.56$8.63$86.33$6.91$4.27$2,07246
NVIDIA RTX A5000 24GB$53.63$53.63$5.82$62.05$1.94$3.35$1,48971
NVIDIA A100 PCIe 80GB$76.92$38.46$27.78$149.99$6.20$19.23$11,99911
NVIDIA Tesla P100 16GB$14.15$7.07$โˆž$9.37$0.20$โˆž$150100
NVIDIA Geforce RTX 4090 24GB$26.63$3.33$4.30$91.67$2.18$1.67$2,200100
NVIDIA Tesla V100 32GB$114.29$57.14$2.50$50.00$1.78$28.57$1,60036
NVIDIA H100 PCIe 80GB$33.07$16.52$54.82$312.49$12.26$8.26$24,9998
AMD Radeon RX 7900 XTX 24GB$12.95$6.42$4.11$32.92$0.82$6.42$790100
NVIDIA L40S 48GB$44.72$22.60$14.41$170.48$9.47$5.58$8,18325
NVIDIA Tesla V100 16GB$30.36$15.18$0.66$26.56$0.47$7.59$42558
AMD Radeon RX 7700 XT 12GB$11.43$5.71$3.70$33.33$0.93$โˆž$40049
AMD Radeon RX 7800 XT 16GB$13.27$6.63$4.09$30.69$0.79$โˆž$49164
AMD Radeon RX 7600 XT 16GB$17.72$8.86$6.25$25.00$1.39$โˆž$4009
NVIDIA GeForce RTX 5080 16GB$10.66$2.67$3.57$75.00$1.25$1.33$1,20099
NVIDIA GeForce RTX 5090 32GB$12.46$3.11$3.84$81.57$1.46$1.56$2,61098
NVIDIA GeForce RTX 5070 Ti 16GB$7.54$1.89$2.53$53.06$0.88$0.94$84999
NVIDIA Geforce RTX 4070 12GB$8.57$2.14$2.71$41.58$0.99$1.07$49999
NVIDIA Geforce RTX 4070 Ti 12GB$9.03$2.26$3.02$60.38$1.44$1.13$72526
NVIDIA Geforce RTX 4080 16GB$9.24$2.26$2.96$56.25$1.26$1.15$90091