GPUs Ranked by Cost per FP32 TFLOPs

Something missing? Let us know and we'll add it if we can.

GPU$ / FP32 TFLOPs $ / FP16 TFLOPs $ / Tensor Core Count $ / Memory Capacity (GB) $ / Memory Bandwidth (GB/s) $ / Int8 TOPs Minimum PriceAvailable for Sale
NVIDIA T4 16GB$61.60$7.68$1.56$31.19$1.56$3.84$49977
NVIDIA A30 24GB$20.91$20.91$15.40$143.75$3.70$10.45$3,45035
NVIDIA A40 48GB$140.37$140.37$15.63$109.38$7.54$17.54$5,25027
NVIDIA A10 24GB$48.08$12.00$5.21$62.50$2.50$6.00$1,50062
NVIDIA L40 48GB$60.77$30.38$9.68$114.58$6.37$15.19$5,50028
AMD Radeon RX 7900 XT 20GB$11.35$5.73$3.51$29.50$0.74$5.73$590100
NVIDIA L4 24GB$15.83$7.85$7.91$79.13$6.33$3.92$1,89954
NVIDIA RTX A5000 24GB$50.41$50.41$5.47$58.33$1.82$3.15$1,40083
NVIDIA A100 PCIe 80GB$73.72$36.86$26.62$143.75$5.94$18.43$11,50011
NVIDIA Tesla P100 16GB$13.02$6.51$โˆž$8.62$0.19$โˆž$138100
NVIDIA Geforce RTX 4090 24GB$26.63$3.33$4.30$91.67$2.18$1.67$2,20093
NVIDIA Tesla V100 32GB$99.14$49.57$2.17$43.38$1.54$24.79$1,38841
NVIDIA H100 PCIe 80GB$36.97$18.47$61.29$349.34$13.71$9.24$27,9479
AMD Radeon RX 7900 XTX 24GB$12.30$6.10$3.91$31.25$0.78$6.10$750100
NVIDIA L40S 48GB$44.72$22.60$14.41$170.48$9.47$5.58$8,18326
NVIDIA Tesla V100 16GB$32.14$16.07$0.70$28.12$0.50$8.04$45060
AMD Radeon RX 7700 XT 12GB$10.86$5.43$3.52$31.67$0.88$โˆž$38059
AMD Radeon RX 7800 XT 16GB$12.84$6.42$3.96$29.69$0.76$โˆž$47578
AMD Radeon RX 7600 XT 16GB$15.57$7.79$5.49$21.97$1.22$โˆž$35115
NVIDIA GeForce RTX 5080 16GB$10.48$2.62$3.51$73.75$1.23$1.31$1,18097
NVIDIA GeForce RTX 5090 32GB$12.41$3.10$3.82$81.22$1.45$1.55$2,59999
NVIDIA GeForce RTX 5070 Ti 16GB$7.41$1.85$2.48$52.16$0.87$0.93$83599
NVIDIA Geforce RTX 4070 12GB$8.33$2.08$2.64$40.41$0.96$1.04$48596
NVIDIA Geforce RTX 4070 Ti 12GB$8.47$2.12$2.83$56.58$1.35$1.06$67921
NVIDIA Geforce RTX 4080 16GB$9.24$2.26$2.96$56.25$1.26$1.15$90094