GPUs Ranked by Cost per Tensor Core Count

This page shows cost ratios of price to performance using a combination of real-time pricing data collected throughout the day and researched performance specifications for the GPU.

Something missing? Let us know and we'll add it if we can.

Compare GPUs by metric:
How much you pay per tensor core. Lower is better.
GPU$ / FP32 TFLOPs $ / FP16 TFLOPs $ / Tensor Core Count $ / Memory Capacity (GB) $ / Memory Bandwidth (GB/s) $ / Int8 TOPs
AMD Radeon RX 7600 XT$12.63$6.31$4.45$17.81$0.99n/a
NVIDIA A10$43.24$10.79$4.68$56.21$2.25$5.40
NVIDIA A100 PCIe$56.99$28.49$20.58$111.13$4.59$14.25
NVIDIA A30$12.73$12.73$9.37$87.50$2.25$6.36
NVIDIA A40$125.67$125.67$13.99$97.92$6.75$15.70
NVIDIA Geforce RTX 4070 Ti$6.23$1.56$2.08$41.66$0.99$0.78
NVIDIA GeForce RTX 5070 Ti$6.35$1.59$2.13$44.69$0.74$0.79
NVIDIA Geforce RTX 4080$8.26$2.02$2.65$50.31$1.12$1.03
NVIDIA Geforce RTX 4070$7.35$1.83$2.32$35.63$0.85$0.92
NVIDIA H100 PCIe$36.20$18.09$60.02$342.10$13.42$9.04
NVIDIA L4$18.23$9.04$9.12$91.17$7.29$4.51
NVIDIA L40$71.82$35.90$11.44$135.42$7.52$17.96
NVIDIA L40S$38.25$19.34$12.32$145.83$8.10$4.77
NVIDIA RTX A5000$53.11$53.11$5.76$61.46$1.92$3.32
NVIDIA T4$9.88$1.23$0.25$5.00$0.25$0.62
NVIDIA Tesla P100$8.49$4.24n/a$5.62$0.12n/a
NVIDIA Tesla V100$12.50$6.25$0.27$10.94$0.19$3.13
NVIDIA Tesla V100$50.00$25.00$1.09$21.87$0.78$12.50
NVIDIA GeForce RTX 5090$12.07$3.02$3.72$79.04$1.41$1.51
AMD Radeon RX 9060 XT$14.26$7.11$5.70$22.81$1.14n/a
AMD Radeon RX 9070 XT$13.35$6.67$5.08$40.63$1.02n/a
NVIDIA GeForce RTX 5060 Ti$17.30$4.32$2.85$25.63$0.92$1.08
NVIDIA GeForce RTX 5080$8.88$2.22$2.98$62.50$1.04$1.11
NVIDIA Geforce RTX 4090$27.83$3.48$4.49$95.79$2.28$1.74
AMD Radeon RX 7900 XTX$10.64$5.28$3.38$27.04$0.68$5.28
NVIDIA GeForce RTX 4080 SUPER$9.28$2.31$3.03$60.56$1.32$1.16
AMD Radeon RX 9070$15.10$7.55$4.87$34.06$0.85n/a
AMD Radeon RX 7900 XT$9.62$4.85$2.98$25.00$0.63$4.85
AMD Radeon RX 7800 XT$10.68$5.34$3.29$24.69$0.63n/a
AMD Radeon RX 7700 XT$10.29$5.14$3.33$30.00$0.83n/a
NVIDIA GeForce RTX 4070 SUPER$14.37$3.59$2.28$42.50$1.01$0.90
AMD Radeon RX 7900 GRE$10.20$5.10$2.93$29.31$0.81$2.55
NVIDIA GeForce RTX 3080$9.57$2.39$1.05$28.50$0.38$0.60
NVIDIA GeForce RTX 3080 Ti$7.30$1.83$0.78$20.75$0.27$0.46