GPUs Ranked by Cost per FP32 TFLOPs

Something missing? Let us know and we'll add it if we can.

GPU$ / FP32 TFLOPs $ / FP16 TFLOPs $ / Tensor Core Count $ / Memory Capacity (GB) $ / Memory Bandwidth (GB/s) $ / Int8 TOPs Minimum PriceAvailable for Sale
NVIDIA T4 16GB$61.73$7.69$1.56$31.25$1.56$3.85$50062
NVIDIA A30 24GB$18.15$18.15$13.37$124.79$3.21$9.08$2,99531
NVIDIA A40 48GB$127.08$127.08$14.15$99.02$6.83$15.88$4,75323
NVIDIA A10 24GB$59.55$14.86$6.45$77.41$3.10$7.43$1,85851
NVIDIA L40 48GB$60.62$30.30$9.66$114.29$6.35$15.15$5,48624
AMD Radeon RX 7900 XT 20GB$13.46$6.80$4.17$35.00$0.88$6.80$70044
NVIDIA L4 24GB$17.92$8.88$8.96$89.58$7.17$4.43$2,15029
NVIDIA RTX A5000 24GB$45.01$45.01$4.88$52.08$1.63$2.81$1,25067
NVIDIA A100 PCIe 80GB$108.97$54.48$39.35$212.49$8.79$27.24$16,9999
NVIDIA Tesla P100 16GB$22.17$11.08$โˆž$14.69$0.32$โˆž$23577
NVIDIA RTX 4090 24GB$22.40$5.60$3.61$77.08$1.84$2.80$1,85020
NVIDIA Tesla V100 32GB$71.36$35.68$1.56$31.22$1.11$17.84$99935
NVIDIA H100 PCIe 80GB$38.35$19.16$63.59$362.44$14.22$9.58$28,99510
AMD Radeon RX 7900 XTX 24GB$14.43$7.15$4.58$36.67$0.92$7.15$88048
NVIDIA L40S 48GB$40.71$20.58$13.12$155.21$8.62$5.08$7,45027
NVIDIA Tesla V100 16GB$42.86$21.43$0.94$37.50$0.67$10.71$60027
AMD Radeon RX 7700 XT 12GB$12.14$6.07$3.94$35.42$0.98$โˆž$42529
AMD Radeon RX 7800 XT 16GB$15.32$7.66$4.72$35.42$0.91$โˆž$56738
AMD Radeon RX 7600 XT 16GB$14.85$7.42$5.24$20.95$1.16$โˆž$33515