GPUs Ranked by Cost per Tensor Core Count

Something missing? Let us know and we'll add it if we can.

GPU$ / FP32 TFLOPs $ / FP16 TFLOPs $ / Tensor Core Count $ / Memory Capacity (GB) $ / Memory Bandwidth (GB/s) $ / Int8 TOPs Minimum PriceAvailable for Sale
NVIDIA T4 16GB$61.73$7.69$1.56$31.25$1.56$3.85$50095
NVIDIA A30 24GB$16.67$16.67$12.28$114.58$2.95$8.33$2,75037
NVIDIA A40 48GB$155.89$155.89$17.35$121.47$8.38$19.48$5,83020
NVIDIA A10 24GB$54.78$13.67$5.93$71.21$2.85$6.84$1,70966
NVIDIA L40 48GB$55.19$27.59$8.79$104.06$5.78$13.80$4,99537
AMD Radeon RX 7900 XT 20GB$14.04$7.09$4.35$36.50$0.91$7.09$73065
NVIDIA L4 24GB$16.25$8.06$8.13$81.25$6.50$4.02$1,95037
NVIDIA RTX A5000 24GB$54.73$54.73$5.94$63.33$1.98$3.42$1,52064
NVIDIA A100 PCIe 80GB$115.38$57.69$41.66$224.99$9.30$28.84$17,99911
NVIDIA Tesla P100 16GB$18.86$9.43$โˆž$12.50$0.27$โˆž$200100
NVIDIA Geforce RTX 4090 24GB$27.93$3.49$4.51$96.13$2.29$1.75$2,30798
NVIDIA Tesla V100 32GB$142.79$71.39$3.12$62.47$2.22$35.70$1,99933
NVIDIA H100 PCIe 80GB$35.55$17.76$58.93$335.91$13.18$8.88$26,87313
AMD Radeon RX 7900 XTX 24GB$15.57$7.72$4.95$39.58$0.99$7.72$95086
NVIDIA L40S 48GB$40.98$20.72$13.20$156.25$8.68$5.12$7,50025
NVIDIA Tesla V100 16GB$39.29$19.64$0.86$34.38$0.61$9.82$55052
AMD Radeon RX 7700 XT 12GB$12.00$6.00$3.89$35.00$0.97$โˆž$42043
AMD Radeon RX 7800 XT 16GB$16.08$8.04$4.96$37.19$0.95$โˆž$59566
AMD Radeon RX 7600 XT 16GB$20.10$10.05$7.09$28.35$1.58$โˆž$45411
NVIDIA GeForce RTX 5080 16GB$12.43$3.11$4.17$87.50$1.46$1.55$1,40099
NVIDIA GeForce RTX 5090 32GB$16.47$4.12$5.07$107.81$1.93$2.06$3,45053
NVIDIA GeForce RTX 5070 Ti 16GB$8.87$2.22$2.97$62.44$1.04$1.11$99981
NVIDIA Geforce RTX 4070 12GB$8.57$2.14$2.71$41.54$0.99$1.07$49951
NVIDIA Geforce RTX 4070 Ti 12GB$8.98$2.24$3.00$60.00$1.43$1.12$72040
NVIDIA Geforce RTX 4080 16GB$11.09$2.71$3.55$67.50$1.51$1.38$1,08076