GPUs Ranked by Cost per FP32 TFLOPs

Something missing? Let us know and we'll add it if we can.

GPU$ / FP32 TFLOPs $ / FP16 TFLOPs $ / Tensor Core Count $ / Memory Capacity (GB) $ / Memory Bandwidth (GB/s) $ / Int8 TOPs Minimum PriceAvailable for Sale
NVIDIA T4 16GB$71.60$8.92$1.81$36.25$1.81$4.46$58084
NVIDIA A30 24GB$17.88$17.88$13.17$122.92$3.16$8.94$2,95046
NVIDIA A40 48GB$114.97$114.97$12.80$89.58$6.18$14.37$4,30037
NVIDIA A10 24GB$35.26$8.80$3.82$45.83$1.83$4.40$1,10070
NVIDIA L40 48GB$56.91$28.45$9.07$107.29$5.96$14.23$5,15027
AMD Radeon RX 7900 XT 20GB$10.67$5.39$3.30$27.75$0.69$5.39$55592
NVIDIA L4 24GB$14.83$7.36$7.42$74.17$5.93$3.67$1,78052
NVIDIA RTX A5000 24GB$50.41$50.41$5.47$58.33$1.82$3.15$1,40070
NVIDIA A100 PCIe 80GB$62.18$31.09$22.45$121.25$5.01$15.54$9,70012
NVIDIA Tesla P100 16GB$9.24$4.62$โˆž$6.12$0.13$โˆž$98100
NVIDIA Geforce RTX 4090 24GB$0.96$0.12$0.15$3.29$0.08$0.06$79100
NVIDIA Tesla V100 32GB$50.00$25.00$1.09$21.87$0.78$12.50$70060
NVIDIA H100 PCIe 80GB$36.46$18.22$60.45$344.58$13.52$9.11$27,56612
AMD Radeon RX 7900 XTX 24GB$10.58$5.25$3.36$26.90$0.67$5.25$645100
NVIDIA L40S 48GB$38.25$19.34$12.32$145.83$8.10$4.77$7,00034
NVIDIA Tesla V100 16GB$20.00$10.00$0.44$17.50$0.31$5.00$28069
AMD Radeon RX 7700 XT 12GB$8.57$4.29$2.78$25.00$0.69$โˆž$30049
AMD Radeon RX 7800 XT 16GB$10.81$5.41$3.33$25.00$0.64$โˆž$40069
AMD Radeon RX 7600 XT 16GB$13.29$6.65$4.69$18.75$1.04$โˆž$30016
NVIDIA GeForce RTX 5080 16GB$8.44$2.11$2.83$59.38$0.99$1.06$950100
NVIDIA GeForce RTX 5090 32GB$11.45$2.86$3.53$74.97$1.34$1.43$2,399100
NVIDIA GeForce RTX 5070 Ti 16GB$6.57$1.64$2.20$46.25$0.77$0.82$740100
NVIDIA Geforce RTX 4070 12GB$7.39$1.84$2.34$35.83$0.85$0.92$43069
NVIDIA Geforce RTX 4070 Ti 12GB$5.54$1.39$1.85$37.04$0.88$0.69$44463
NVIDIA Geforce RTX 4080 16GB$8.01$1.96$2.57$48.75$1.09$1.00$780100