GPUs Ranked by Cost per Tensor Core Count

Something missing? Let us know and we'll add it if we can.

GPU$ / FP32 TFLOPs $ / FP16 TFLOPs $ / Tensor Core Count $ / Memory Capacity (GB) $ / Memory Bandwidth (GB/s) $ / Int8 TOPs Minimum PriceAvailable for Sale
NVIDIA T4 16GB$67.90$8.46$1.72$34.38$1.72$4.23$55086
NVIDIA A30 24GB$13.94$13.94$10.27$95.83$2.46$6.97$2,30044
NVIDIA A40 48GB$140.37$140.37$15.63$109.38$7.54$17.54$5,25029
NVIDIA A10 24GB$44.84$11.19$4.86$58.29$2.33$5.60$1,39968
NVIDIA L40 48GB$55.24$27.61$8.80$104.15$5.79$13.81$4,99928
AMD Radeon RX 7900 XT 20GB$11.44$5.78$3.54$29.75$0.74$5.78$59591
NVIDIA L4 24GB$15.63$7.75$7.81$78.13$6.25$3.87$1,87555
NVIDIA RTX A5000 24GB$46.74$46.74$5.07$54.08$1.69$2.92$1,29885
NVIDIA A100 PCIe 80GB$67.29$33.65$24.30$131.23$5.43$16.82$10,49811
NVIDIA Tesla P100 16GB$10.85$5.42$โˆž$7.19$0.16$โˆž$115100
NVIDIA Geforce RTX 4090 24GB$26.63$3.33$4.30$91.67$2.18$1.67$2,20099
NVIDIA Tesla V100 32GB$76.86$38.43$1.68$33.63$1.20$19.22$1,07651
NVIDIA H100 PCIe 80GB$36.55$18.26$60.59$345.37$13.55$9.13$27,63010
AMD Radeon RX 7900 XTX 24GB$12.46$6.18$3.96$31.67$0.79$6.18$76099
NVIDIA L40S 48GB$41.12$20.79$13.25$156.77$8.71$5.13$7,52530
NVIDIA Tesla V100 16GB$26.70$13.35$0.58$23.36$0.42$6.68$37460
AMD Radeon RX 7700 XT 12GB$9.29$4.64$3.01$27.08$0.75$โˆž$32566
AMD Radeon RX 7800 XT 16GB$13.19$6.59$4.07$30.50$0.78$โˆž$48879
AMD Radeon RX 7600 XT 16GB$13.29$6.65$4.69$18.75$1.04$โˆž$30021
NVIDIA GeForce RTX 5080 16GB$8.87$2.22$2.97$62.44$1.04$1.11$999100
NVIDIA GeForce RTX 5090 32GB$11.45$2.86$3.53$74.97$1.34$1.43$2,399100
NVIDIA GeForce RTX 5070 Ti 16GB$7.02$1.75$2.35$49.37$0.82$0.88$79099
NVIDIA Geforce RTX 4070 12GB$7.39$1.84$2.34$35.83$0.85$0.92$430100
NVIDIA Geforce RTX 4070 Ti 12GB$7.22$1.80$2.41$48.25$1.15$0.90$57930
NVIDIA Geforce RTX 4080 16GB$8.73$2.13$2.80$53.13$1.19$1.09$85098