GPUs Ranked by Cost per FP32 TFLOPs

Something missing? Let us know and we'll add it if we can.

GPU$ / FP32 TFLOPs $ / FP16 TFLOPs $ / Tensor Core Count $ / Memory Capacity (GB) $ / Memory Bandwidth (GB/s) $ / Int8 TOPs Minimum PriceAvailable for Sale
NVIDIA T4 16GB$74.07$9.23$1.87$37.50$1.87$4.62$60092
NVIDIA A30 24GB$17.33$17.33$12.77$119.17$3.06$8.67$2,86036
NVIDIA A40 48GB$176.79$176.79$19.68$137.75$9.50$22.09$6,61226
NVIDIA A10 24GB$48.08$12.00$5.21$62.50$2.50$6.00$1,50061
NVIDIA L40 48GB$50.94$25.46$8.12$96.04$5.34$12.73$4,61052
AMD Radeon RX 7900 XT 20GB$13.46$6.80$4.17$35.00$0.88$6.80$70072
NVIDIA L4 24GB$17.33$8.59$8.66$86.63$6.93$4.29$2,07929
NVIDIA RTX A5000 24GB$56.50$56.50$6.13$65.38$2.04$3.53$1,56968
NVIDIA A100 PCIe 80GB$104.17$52.08$37.62$203.13$8.40$26.04$16,25011
NVIDIA Tesla P100 16GB$16.51$8.25$โˆž$10.94$0.24$โˆž$175100
NVIDIA Geforce RTX 4090 24GB$27.83$3.48$4.49$95.79$2.28$1.74$2,299100
NVIDIA Tesla V100 32GB$111.05$55.53$2.43$48.59$1.73$27.76$1,55533
NVIDIA H100 PCIe 80GB$38.35$19.16$63.59$362.44$14.22$9.58$28,99512
AMD Radeon RX 7900 XTX 24GB$13.69$6.79$4.35$34.79$0.87$6.79$83599
NVIDIA L40S 48GBn/an/an/an/an/an/an/a0
NVIDIA Tesla V100 16GB$45.00$22.50$0.98$39.37$0.70$11.25$63045
AMD Radeon RX 7700 XT 12GB$13.28$6.64$4.31$38.75$1.08$โˆž$46544
AMD Radeon RX 7800 XT 16GB$15.13$7.57$4.67$35.00$0.90$โˆž$56061
AMD Radeon RX 7600 XT 16GB$15.51$7.75$5.47$21.87$1.22$โˆž$3509
NVIDIA GeForce RTX 5080 16GB$11.54$2.89$3.87$81.25$1.35$1.44$1,300100
NVIDIA GeForce RTX 5090 32GB$15.03$3.76$4.63$98.38$1.76$1.88$3,14881
NVIDIA GeForce RTX 5070 Ti 16GB$8.79$2.20$2.95$61.87$1.03$1.10$99093
NVIDIA Geforce RTX 4070 12GB$9.04$2.26$2.86$43.83$1.04$1.13$52663
NVIDIA Geforce RTX 4070 Ti 12GB$8.98$2.24$3.00$60.00$1.43$1.12$72045
NVIDIA Geforce RTX 4080 16GB$9.88$2.41$3.16$60.13$1.34$1.23$96283