GPUs Ranked by Cost per Tensor Core Count

Something missing? Let us know and we'll add it if we can.

GPU$ / FP32 TFLOPs $ / FP16 TFLOPs $ / Tensor Core Count $ / Memory Capacity (GB) $ / Memory Bandwidth (GB/s) $ / Int8 TOPs Minimum PriceAvailable for Sale
NVIDIA T4 16GB$3.24$0.40$0.08$1.64$0.08$0.20$2685
NVIDIA A30 24GB$21.27$21.27$15.67$146.25$3.76$10.64$3,51037
NVIDIA A40 48GB$155.69$155.69$17.33$121.31$8.37$19.46$5,82326
NVIDIA A10 24GB$57.53$14.36$6.23$74.79$2.99$7.18$1,79566
NVIDIA L40 48GB$55.19$27.59$8.79$104.06$5.78$13.80$4,99541
AMD Radeon RX 7900 XT 20GB$13.17$6.65$4.08$34.25$0.86$6.65$68559
NVIDIA L4 24GB$16.67$8.26$8.33$83.33$6.67$4.12$2,00036
NVIDIA RTX A5000 24GB$47.89$47.89$5.20$55.42$1.73$2.99$1,33066
NVIDIA A100 PCIe 80GB$115.38$57.69$41.66$224.99$9.30$28.84$17,99919
NVIDIA Tesla P100 16GB$2.98$1.49$โˆž$1.98$0.04$โˆž$32100
NVIDIA Geforce RTX 4090 24GB$27.23$3.40$4.39$93.71$2.23$1.70$2,24999
NVIDIA Tesla V100 32GB$124.30$62.15$2.72$54.38$1.93$31.08$1,74034
NVIDIA H100 PCIe 80GB$35.39$17.68$58.67$334.43$13.12$8.84$26,75511
AMD Radeon RX 7900 XTX 24GB$16.39$8.13$5.21$41.67$1.04$8.13$1,00074
NVIDIA L40S 48GB$43.69$22.09$14.08$166.56$9.25$5.45$7,99527
NVIDIA Tesla V100 16GB$46.43$23.21$1.02$40.63$0.72$11.61$65045
AMD Radeon RX 7700 XT 12GB$12.86$6.43$4.17$37.50$1.04$โˆž$45037
AMD Radeon RX 7800 XT 16GB$15.67$7.84$4.83$36.25$0.93$โˆž$58055
AMD Radeon RX 7600 XT 16GB$20.10$10.05$7.09$28.35$1.58$โˆž$45410
NVIDIA GeForce RTX 5080 16GB$13.76$3.44$4.61$96.81$1.61$1.72$1,54994
NVIDIA GeForce RTX 5090 32GB$9.30$2.33$2.87$60.89$1.09$1.16$1,94947
NVIDIA GeForce RTX 5070 Ti 16GB$9.64$2.41$3.23$67.81$1.13$1.21$1,08587
NVIDIA Geforce RTX 4070 12GB$8.57$2.14$2.71$41.54$0.99$1.07$49945
NVIDIA Geforce RTX 4070 Ti 12GB$9.98$2.49$3.33$66.67$1.59$1.25$80030
NVIDIA Geforce RTX 4080 16GB$14.25$3.48$4.57$86.75$1.94$1.78$1,38881