GPUs Ranked by Cost per FP16 TFLOPs

Something missing? Let us know and we'll add it if we can.

GPU$ / FP32 TFLOPs $ / FP16 TFLOPs $ / Tensor Core Count $ / Memory Capacity (GB) $ / Memory Bandwidth (GB/s) $ / Int8 TOPs Minimum PriceAvailable for Sale
NVIDIA T4 16GB$64.20$8.00$1.63$32.50$1.63$4.00$52081
NVIDIA A30 24GB$14.55$14.55$10.71$100.00$2.57$7.27$2,40034
NVIDIA A40 48GB$160.43$160.43$17.86$125.00$8.62$20.05$6,00027
NVIDIA A10 24GB$41.63$10.39$4.51$54.13$2.17$5.20$1,29967
NVIDIA L40 48GB$60.50$30.24$9.64$114.06$6.34$15.12$5,47527
AMD Radeon RX 7900 XT 20GB$9.85$4.97$3.05$25.60$0.64$4.97$51270
NVIDIA L4 24GB$17.29$8.57$8.65$86.46$6.92$4.28$2,07546
NVIDIA RTX A5000 24GB$46.78$46.78$5.07$54.13$1.69$2.92$1,29972
NVIDIA A100 PCIe 80GB$76.92$38.46$27.78$149.99$6.20$19.23$11,9999
NVIDIA Tesla P100 16GB$14.15$7.07$โˆž$9.37$0.20$โˆž$150100
NVIDIA Geforce RTX 4090 24GB$25.42$3.18$4.10$87.50$2.08$1.59$2,100100
NVIDIA Tesla V100 32GB$114.29$57.14$2.50$50.00$1.78$28.57$1,60034
NVIDIA H100 PCIe 80GB$37.12$18.55$61.55$350.82$13.76$9.27$28,0667
AMD Radeon RX 7900 XTX 24GB$13.11$6.50$4.17$33.33$0.83$6.50$800100
NVIDIA L40S 48GB$44.72$22.60$14.41$170.48$9.47$5.58$8,18324
NVIDIA Tesla V100 16GB$32.14$16.07$0.70$28.12$0.50$8.04$45057
AMD Radeon RX 7700 XT 12GB$11.43$5.71$3.70$33.33$0.93$โˆž$40054
AMD Radeon RX 7800 XT 16GB$13.95$6.97$4.30$32.25$0.83$โˆž$51666
AMD Radeon RX 7600 XT 16GB$14.18$7.09$5.00$20.00$1.11$โˆž$32010
NVIDIA GeForce RTX 5080 16GB$10.66$2.67$3.57$75.00$1.25$1.33$1,20099
NVIDIA GeForce RTX 5090 32GB$12.49$3.12$3.85$81.79$1.46$1.56$2,61799
NVIDIA GeForce RTX 5070 Ti 16GB$7.54$1.89$2.53$53.06$0.88$0.94$849100
NVIDIA Geforce RTX 4070 12GB$8.33$2.08$2.64$40.42$0.96$1.04$48597
NVIDIA Geforce RTX 4070 Ti 12GB$7.85$1.96$2.62$52.50$1.25$0.98$63025
NVIDIA Geforce RTX 4080 16GB$9.45$2.31$3.03$57.50$1.28$1.18$92095