GPUs Ranked by Cost per FP16 TFLOPs

Something missing? Let us know and we'll add it if we can.

GPU$ / FP32 TFLOPs $ / FP16 TFLOPs $ / Tensor Core Count $ / Memory Capacity (GB) $ / Memory Bandwidth (GB/s) $ / Int8 TOPs Minimum PriceAvailable for Sale
NVIDIA T4 16GB$61.73$7.69$1.56$31.25$1.56$3.85$50090
NVIDIA A30 24GB$16.97$16.97$12.50$116.67$3.00$8.48$2,80037
NVIDIA A40 48GB$155.70$155.70$17.33$121.32$8.37$19.46$5,82325
NVIDIA A10 24GB$54.78$13.67$5.93$71.21$2.85$6.84$1,70965
NVIDIA L40 48GB$55.19$27.59$8.79$104.06$5.78$13.80$4,99559
AMD Radeon RX 7900 XT 20GB$14.81$7.48$4.58$38.50$0.96$7.48$77066
NVIDIA L4 24GB$16.25$8.06$8.13$81.25$6.50$4.02$1,95037
NVIDIA RTX A5000 24GB$51.82$51.82$5.62$59.96$1.87$3.24$1,43964
NVIDIA A100 PCIe 80GB$115.38$57.69$41.66$224.99$9.30$28.84$17,99916
NVIDIA Tesla P100 16GB$18.86$9.43$โˆž$12.50$0.27$โˆž$200100
NVIDIA Geforce RTX 4090 24GB$27.91$3.49$4.50$96.07$2.29$1.75$2,306100
NVIDIA Tesla V100 32GB$125.00$62.50$2.73$54.69$1.94$31.25$1,75038
NVIDIA H100 PCIe 80GB$35.52$17.75$58.89$335.67$13.17$8.87$26,85413
AMD Radeon RX 7900 XTX 24GB$16.23$8.05$5.16$41.25$1.03$8.05$99084
NVIDIA L40S 48GBn/an/an/an/an/an/an/a0
NVIDIA Tesla V100 16GB$43.89$21.94$0.96$38.40$0.68$10.97$61448
AMD Radeon RX 7700 XT 12GB$12.00$6.00$3.89$35.00$0.97$โˆž$42041
AMD Radeon RX 7800 XT 16GB$16.16$8.08$4.98$37.38$0.96$โˆž$59868
AMD Radeon RX 7600 XT 16GB$19.49$9.75$6.87$27.50$1.53$โˆž$44013
NVIDIA GeForce RTX 5080 16GB$12.39$3.10$4.15$87.19$1.45$1.55$1,395100
NVIDIA GeForce RTX 5090 32GB$17.37$4.34$5.35$113.75$2.03$2.17$3,64055
NVIDIA GeForce RTX 5070 Ti 16GB$9.06$2.27$3.04$63.75$1.06$1.13$1,02076
NVIDIA Geforce RTX 4070 12GB$8.57$2.14$2.71$41.54$0.99$1.07$49950
NVIDIA Geforce RTX 4070 Ti 12GB$8.98$2.24$3.00$60.00$1.43$1.12$72043
NVIDIA Geforce RTX 4080 16GB$11.12$2.72$3.56$67.68$1.51$1.39$1,08383