GPUs Ranked by Cost per FP16 TFLOPs

Something missing? Let us know and we'll add it if we can.

GPU$ / FP32 TFLOPs $ / FP16 TFLOPs $ / Tensor Core Count $ / Memory Capacity (GB) $ / Memory Bandwidth (GB/s) $ / Int8 TOPs Minimum PriceAvailable for Sale
NVIDIA T4 16GB$74.07$9.23$1.88$37.50$1.88$4.62$60078
NVIDIA A30 24GB$20.91$20.91$15.40$143.75$3.70$10.45$3,45035
NVIDIA A40 48GB$140.37$140.37$15.63$109.38$7.54$17.54$5,25027
NVIDIA A10 24GB$57.69$14.40$6.25$75.00$3.00$7.20$1,80061
NVIDIA L40 48GB$60.77$30.38$9.68$114.58$6.37$15.19$5,50028
AMD Radeon RX 7900 XT 20GB$11.52$5.82$3.57$29.95$0.75$5.82$599100
NVIDIA L4 24GB$15.83$7.85$7.91$79.13$6.33$3.92$1,89954
NVIDIA RTX A5000 24GB$49.69$49.69$5.39$57.50$1.80$3.11$1,38084
NVIDIA A100 PCIe 80GB$73.72$36.86$26.62$143.75$5.94$18.43$11,50012
NVIDIA Tesla P100 16GB$13.02$6.51$โˆž$8.62$0.19$โˆž$138100
NVIDIA Geforce RTX 4090 24GB$27.24$3.41$4.39$93.75$2.23$1.70$2,25099
NVIDIA Tesla V100 32GB$99.14$49.57$2.17$43.38$1.54$24.79$1,38842
NVIDIA H100 PCIe 80GB$34.39$17.18$57.02$325.00$12.75$8.59$26,00010
AMD Radeon RX 7900 XTX 24GB$12.95$6.42$4.11$32.92$0.82$6.42$790100
NVIDIA L40S 48GB$44.72$22.60$14.41$170.48$9.47$5.58$8,18326
NVIDIA Tesla V100 16GB$32.14$16.07$0.70$28.12$0.50$8.04$45061
AMD Radeon RX 7700 XT 12GB$11.09$5.54$3.59$32.33$0.90$โˆž$38858
AMD Radeon RX 7800 XT 16GB$12.84$6.42$3.96$29.69$0.76$โˆž$47579
AMD Radeon RX 7600 XT 16GB$16.35$8.17$5.77$23.06$1.28$โˆž$36916
NVIDIA GeForce RTX 5080 16GB$10.57$2.64$3.54$74.37$1.24$1.32$1,190100
NVIDIA GeForce RTX 5090 32GB$12.41$3.10$3.82$81.22$1.45$1.55$2,599100
NVIDIA GeForce RTX 5070 Ti 16GB$7.36$1.84$2.47$51.81$0.86$0.92$829100
NVIDIA Geforce RTX 4070 12GB$8.16$2.04$2.58$39.58$0.94$1.02$47565
NVIDIA Geforce RTX 4070 Ti 12GB$7.36$1.84$2.46$49.17$1.17$0.92$59059
NVIDIA Geforce RTX 4080 16GB$9.02$2.20$2.89$54.94$1.23$1.13$87998