GPUs Ranked by Cost per FP32 TFLOPs

Something missing? Let us know and we'll add it if we can.

GPU$ / FP32 TFLOPs $ / FP16 TFLOPs $ / Tensor Core Count $ / Memory Capacity (GB) $ / Memory Bandwidth (GB/s) $ / Int8 TOPs Minimum PriceAvailable for Sale
NVIDIA T4 16GB$76.54$9.54$1.94$38.75$1.94$4.77$62071
NVIDIA A30 24GB$17.88$17.88$13.17$122.92$3.16$8.94$2,95034
NVIDIA A40 48GB$120.32$120.32$13.39$93.75$6.47$15.04$4,50028
NVIDIA A10 24GB$63.11$15.75$6.84$82.05$3.28$7.88$1,96961
NVIDIA L40 48GB$60.54$30.26$9.65$114.15$6.34$15.14$5,47929
AMD Radeon RX 7900 XT 20GB$18.26$9.22$5.65$47.49$1.19$9.22$95031
NVIDIA L4 24GB$15.83$7.85$7.92$79.17$6.33$3.92$1,90027
NVIDIA RTX A5000 24GB$47.89$47.89$5.20$55.42$1.73$2.99$1,33061
NVIDIA A100 PCIe 80GB$115.38$57.69$41.66$224.99$9.30$28.84$17,99912
NVIDIA Tesla P100 16GB$18.87$9.43$โˆž$12.50$0.27$โˆž$20089
NVIDIA RTX 4090 24GB$29.06$3.63$4.69$100.00$2.38$1.82$2,40099
NVIDIA Tesla V100 32GB$128.57$64.29$2.81$56.25$2.00$32.14$1,80033
NVIDIA H100 PCIe 80GB$29.76$14.87$49.34$281.25$11.03$7.44$22,50013
AMD Radeon RX 7900 XTX 24GB$16.80$8.33$5.34$42.70$1.07$8.33$1,02566
NVIDIA L40S 48GB$38.52$19.48$12.41$146.87$8.16$4.81$7,05030
NVIDIA Tesla V100 16GB$45.71$22.86$1.00$40.00$0.71$11.43$64044
AMD Radeon RX 7700 XT 12GB$13.14$6.57$4.26$38.33$1.06$โˆž$46029
AMD Radeon RX 7800 XT 16GB$17.16$8.58$5.29$39.69$1.02$โˆž$63547
AMD Radeon RX 7600 XT 16GB$20.10$10.05$7.09$28.35$1.58$โˆž$45410
NVIDIA RTX 5090 32GB$13.51$5.12$6.31$134.06$2.39$2.56$4,29057