GPUs Ranked by Cost per FP16 TFLOPs

Something missing? Let us know and we'll add it if we can.

GPU$ / FP32 TFLOPs $ / FP16 TFLOPs $ / Tensor Core Count $ / Memory Capacity (GB) $ / Memory Bandwidth (GB/s) $ / Int8 TOPs Minimum PriceAvailable for Sale
NVIDIA T4 16GB$82.59$10.29$2.09$41.81$2.09$5.15$66983
NVIDIA A30 24GB$14.55$14.55$10.71$100.00$2.57$7.27$2,40031
NVIDIA A40 48GB$160.43$160.43$17.86$125.00$8.62$20.05$6,00027
NVIDIA A10 24GB$40.06$10.00$4.34$52.08$2.08$5.00$1,25068
NVIDIA L40 48GB$62.43$31.21$9.95$117.71$6.54$15.61$5,65029
AMD Radeon RX 7900 XT 20GB$12.12$6.12$3.75$31.50$0.79$6.12$63085
NVIDIA L4 24GB$13.33$6.61$6.67$66.67$5.33$3.30$1,60049
NVIDIA RTX A5000 24GB$53.27$53.27$5.78$61.63$1.93$3.33$1,47981
NVIDIA A100 PCIe 80GB$76.92$38.46$27.78$149.99$6.20$19.23$11,99911
NVIDIA Tesla P100 16GB$14.15$7.07$โˆž$9.37$0.20$โˆž$150100
NVIDIA Geforce RTX 4090 24GB$26.63$3.33$4.30$91.67$2.18$1.67$2,20096
NVIDIA Tesla V100 32GB$92.86$46.43$2.03$40.63$1.44$23.21$1,30033
NVIDIA H100 PCIe 80GB$31.74$15.86$52.63$299.99$11.77$7.93$23,9998
AMD Radeon RX 7900 XTX 24GB$13.11$6.50$4.17$33.33$0.83$6.50$800100
NVIDIA L40S 48GB$44.72$22.60$14.41$170.48$9.47$5.58$8,18325
NVIDIA Tesla V100 16GB$30.36$15.18$0.66$26.56$0.47$7.59$42558
AMD Radeon RX 7700 XT 12GB$11.46$5.73$3.71$33.42$0.93$โˆž$40153
AMD Radeon RX 7800 XT 16GB$13.11$6.55$4.04$30.31$0.78$โˆž$48562
AMD Radeon RX 7600 XT 16GB$15.51$7.75$5.47$21.87$1.22$โˆž$3508
NVIDIA GeForce RTX 5080 16GB$11.10$2.78$3.72$78.12$1.30$1.39$1,250100
NVIDIA GeForce RTX 5090 32GB$12.41$3.10$3.82$81.22$1.45$1.55$2,59998
NVIDIA GeForce RTX 5070 Ti 16GB$7.54$1.89$2.53$53.06$0.88$0.94$84999
NVIDIA Geforce RTX 4070 12GB$8.59$2.14$2.72$41.66$0.99$1.07$50098
NVIDIA Geforce RTX 4070 Ti 12GB$9.03$2.26$3.02$60.38$1.44$1.13$72527
NVIDIA Geforce RTX 4080 16GB$8.79$2.15$2.82$53.52$1.19$1.10$85699