GPUs Ranked by Cost per FP32 TFLOPs

Something missing? Let us know and we'll add it if we can.

GPU$ / FP32 TFLOPs $ / FP16 TFLOPs $ / Tensor Core Count $ / Memory Capacity (GB) $ / Memory Bandwidth (GB/s) $ / Int8 TOPs Minimum PriceAvailable for Sale
NVIDIA T4 16GB$77.16$9.62$1.95$39.06$1.95$4.81$62582
NVIDIA A30 24GB$13.94$13.94$10.27$95.83$2.46$6.97$2,30033
NVIDIA A40 48GB$126.74$126.74$14.11$98.75$6.81$15.84$4,74032
NVIDIA A10 24GB$44.84$11.19$4.86$58.29$2.33$5.60$1,39963
NVIDIA L40 48GB$62.43$31.21$9.95$117.71$6.54$15.61$5,65027
AMD Radeon RX 7900 XT 20GB$11.83$5.97$3.66$30.75$0.77$5.97$61584
NVIDIA L4 24GB$17.27$8.56$8.63$86.33$6.91$4.27$2,07246
NVIDIA RTX A5000 24GB$53.27$53.27$5.78$61.63$1.93$3.33$1,47981
NVIDIA A100 PCIe 80GB$76.92$38.46$27.78$149.99$6.20$19.23$11,99911
NVIDIA Tesla P100 16GB$13.96$6.98$โˆž$9.25$0.20$โˆž$14899
NVIDIA Geforce RTX 4090 24GB$26.63$3.33$4.30$91.67$2.18$1.67$2,200100
NVIDIA Tesla V100 32GB$107.14$53.57$2.34$46.87$1.67$26.79$1,50034
NVIDIA H100 PCIe 80GB$30.42$15.20$50.44$287.49$11.28$7.60$22,9998
AMD Radeon RX 7900 XTX 24GB$12.46$6.18$3.96$31.67$0.79$6.18$76099
NVIDIA L40S 48GB$44.72$22.60$14.41$170.48$9.47$5.58$8,18324
NVIDIA Tesla V100 16GB$35.71$17.85$0.78$31.24$0.56$8.93$50056
AMD Radeon RX 7700 XT 12GB$10.29$5.14$3.33$30.00$0.83$โˆž$36050
AMD Radeon RX 7800 XT 16GB$13.24$6.62$4.08$30.62$0.79$โˆž$49066
AMD Radeon RX 7600 XT 16GB$13.07$6.54$4.61$18.44$1.02$โˆž$29511
NVIDIA GeForce RTX 5080 16GB$10.71$2.68$3.59$75.40$1.26$1.34$1,206100
NVIDIA GeForce RTX 5090 32GB$12.41$3.10$3.82$81.22$1.45$1.55$2,59998
NVIDIA GeForce RTX 5070 Ti 16GB$7.33$1.83$2.46$51.56$0.86$0.92$825100
NVIDIA Geforce RTX 4070 12GB$8.33$2.08$2.64$40.42$0.96$1.04$48595
NVIDIA Geforce RTX 4070 Ti 12GB$11.22$2.81$3.75$75.00$1.79$1.40$90022
NVIDIA Geforce RTX 4080 16GB$9.45$2.31$3.03$57.50$1.28$1.18$92094