GPUs Ranked by Cost per FP32 TFLOPs

Something missing? Let us know and we'll add it if we can.

GPU$ / FP32 TFLOPs $ / FP16 TFLOPs $ / Tensor Core Count $ / Memory Capacity (GB) $ / Memory Bandwidth (GB/s) $ / Int8 TOPs Minimum PriceAvailable for Sale
NVIDIA T4 16GB$73.95$9.22$1.87$37.44$1.87$4.61$59991
NVIDIA A30 24GB$19.99$19.99$14.73$137.46$3.53$10.00$3,29941
NVIDIA A40 48GB$120.32$120.32$13.39$93.75$6.47$15.04$4,50031
NVIDIA A10 24GB$44.84$11.19$4.86$58.29$2.33$5.60$1,39968
NVIDIA L40 48GB$60.22$30.10$9.60$113.54$6.31$15.06$5,45027
AMD Radeon RX 7900 XT 20GB$11.33$5.72$3.51$29.45$0.74$5.72$58991
NVIDIA L4 24GB$15.63$7.75$7.81$78.13$6.25$3.87$1,87552
NVIDIA RTX A5000 24GB$46.74$46.74$5.07$54.08$1.69$2.92$1,29878
NVIDIA A100 PCIe 80GB$66.99$33.49$24.19$130.63$5.40$16.75$10,45010
NVIDIA Tesla P100 16GB$9.55$4.78$โˆž$6.33$0.14$โˆž$101100
NVIDIA Geforce RTX 4090 24GB$24.82$3.10$4.00$85.42$2.03$1.55$2,05099
NVIDIA Tesla V100 32GB$77.00$38.50$1.68$33.69$1.20$19.25$1,07850
NVIDIA H100 PCIe 80GB$36.87$18.42$61.12$348.38$13.67$9.21$27,8709
AMD Radeon RX 7900 XTX 24GB$11.80$5.85$3.75$30.00$0.75$5.85$720100
NVIDIA L40S 48GB$39.89$20.17$12.85$152.08$8.45$4.98$7,30030
NVIDIA Tesla V100 16GB$26.93$13.47$0.59$23.57$0.42$6.73$37762
AMD Radeon RX 7700 XT 12GB$9.86$4.93$3.19$28.75$0.80$โˆž$34559
AMD Radeon RX 7800 XT 16GB$12.70$6.35$3.92$29.38$0.75$โˆž$47077
AMD Radeon RX 7600 XT 16GB$13.29$6.65$4.69$18.75$1.04$โˆž$30021
NVIDIA GeForce RTX 5080 16GB$8.88$2.22$2.98$62.50$1.04$1.11$1,000100
NVIDIA GeForce RTX 5090 32GB$10.97$2.74$3.38$71.84$1.28$1.37$2,299100
NVIDIA GeForce RTX 5070 Ti 16GB$7.45$1.86$2.50$52.44$0.87$0.93$83997
NVIDIA Geforce RTX 4070 12GB$8.33$2.08$2.64$40.42$0.96$1.04$48597
NVIDIA Geforce RTX 4070 Ti 12GB$7.22$1.80$2.41$48.25$1.15$0.90$57928
NVIDIA Geforce RTX 4080 16GB$8.73$2.13$2.80$53.13$1.19$1.09$85099