GPUs Ranked by Cost per FP32 TFLOPs

Something missing? Let us know and we'll add it if we can.

GPU$ / FP32 TFLOPs $ / FP16 TFLOPs $ / Tensor Core Count $ / Memory Capacity (GB) $ / Memory Bandwidth (GB/s) $ / Int8 TOPs Minimum PriceAvailable for Sale
NVIDIA T4 16GB$79.01$9.85$2.00$40.00$2.00$4.92$64083
NVIDIA A30 24GB$13.33$13.33$9.82$91.63$2.36$6.66$2,19944
NVIDIA A40 48GB$140.37$140.37$15.63$109.38$7.54$17.54$5,25027
NVIDIA A10 24GB$43.27$10.80$4.69$56.25$2.25$5.40$1,35064
NVIDIA L40 48GB$60.22$30.10$9.60$113.54$6.31$15.06$5,45027
AMD Radeon RX 7900 XT 20GB$10.96$5.53$3.39$28.50$0.71$5.53$57087
NVIDIA L4 24GB$15.63$7.75$7.81$78.13$6.25$3.87$1,87555
NVIDIA RTX A5000 24GB$43.18$43.18$4.68$49.96$1.56$2.70$1,19986
NVIDIA A100 PCIe 80GB$73.08$36.54$26.39$142.50$5.89$18.27$11,40012
NVIDIA Tesla P100 16GB$11.60$5.80$โˆž$7.68$0.17$โˆž$12398
NVIDIA Geforce RTX 4090 24GB$26.42$3.30$4.26$90.94$2.17$1.65$2,183100
NVIDIA Tesla V100 32GB$77.95$38.97$1.71$34.10$1.21$19.49$1,09144
NVIDIA H100 PCIe 80GB$26.45$13.22$43.86$249.99$9.81$6.61$19,99910
AMD Radeon RX 7900 XTX 24GB$12.13$6.02$3.85$30.83$0.77$6.02$740100
NVIDIA L40S 48GB$42.35$21.41$13.64$161.46$8.97$5.29$7,75028
NVIDIA Tesla V100 16GB$29.29$14.64$0.64$25.63$0.46$7.32$41061
AMD Radeon RX 7700 XT 12GB$10.00$5.00$3.24$29.17$0.81$โˆž$35051
AMD Radeon RX 7800 XT 16GB$12.84$6.42$3.96$29.69$0.76$โˆž$47568
AMD Radeon RX 7600 XT 16GB$12.63$6.31$4.45$17.81$0.99$โˆž$28511
NVIDIA GeForce RTX 5080 16GB$10.12$2.53$3.39$71.25$1.19$1.27$1,140100
NVIDIA GeForce RTX 5090 32GB$10.57$2.64$3.26$69.23$1.24$1.32$2,215100
NVIDIA GeForce RTX 5070 Ti 16GB$7.46$1.86$2.50$52.47$0.87$0.93$840100
NVIDIA Geforce RTX 4070 12GB$8.25$2.06$2.61$40.00$0.95$1.03$48062
NVIDIA Geforce RTX 4070 Ti 12GB$7.29$1.82$2.44$48.75$1.16$0.91$58559
NVIDIA Geforce RTX 4080 16GB$8.62$2.11$2.76$52.50$1.17$1.08$84097