GPUs Ranked by Cost per FP16 TFLOPs

Something missing? Let us know and we'll add it if we can.

GPU$ / FP32 TFLOPs $ / FP16 TFLOPs $ / Tensor Core Count $ / Memory Capacity (GB) $ / Memory Bandwidth (GB/s) $ / Int8 TOPs Minimum PriceAvailable for Sale
NVIDIA T4 16GB$71.60$8.92$1.81$36.25$1.81$4.46$58085
NVIDIA A30 24GB$17.88$17.88$13.17$122.92$3.16$8.94$2,95046
NVIDIA A40 48GB$112.30$112.30$12.50$87.50$6.03$14.03$4,20037
NVIDIA A10 24GB$35.26$8.80$3.82$45.83$1.83$4.40$1,10071
NVIDIA L40 48GB$55.19$27.59$8.79$104.06$5.78$13.80$4,99527
AMD Radeon RX 7900 XT 20GB$10.58$5.34$3.27$27.50$0.69$5.34$55094
NVIDIA L4 24GB$14.83$7.36$7.42$74.17$5.93$3.67$1,78055
NVIDIA RTX A5000 24GB$50.41$50.41$5.47$58.33$1.82$3.15$1,40068
NVIDIA A100 PCIe 80GB$62.18$31.09$22.45$121.25$5.01$15.54$9,70014
NVIDIA Tesla P100 16GB$9.24$4.62$โˆž$6.12$0.13$โˆž$98100
NVIDIA Geforce RTX 4090 24GB$0.96$0.12$0.15$3.29$0.08$0.06$79100
NVIDIA Tesla V100 32GB$50.00$25.00$1.09$21.87$0.78$12.50$70060
NVIDIA H100 PCIe 80GB$36.45$18.21$60.42$344.41$13.51$9.11$27,55312
AMD Radeon RX 7900 XTX 24GB$10.58$5.25$3.36$26.88$0.67$5.25$645100
NVIDIA L40S 48GB$38.25$19.34$12.32$145.83$8.10$4.77$7,00034
NVIDIA Tesla V100 16GB$20.00$10.00$0.44$17.50$0.31$5.00$28069
AMD Radeon RX 7700 XT 12GB$8.57$4.29$2.78$25.00$0.69$โˆž$30058
AMD Radeon RX 7800 XT 16GB$10.92$5.46$3.37$25.25$0.65$โˆž$40475
AMD Radeon RX 7600 XT 16GB$13.29$6.65$4.69$18.75$1.04$โˆž$30017
NVIDIA GeForce RTX 5080 16GB$7.55$1.89$2.53$53.13$0.89$0.94$85099
NVIDIA GeForce RTX 5090 32GB$11.45$2.86$3.53$74.94$1.34$1.43$2,398100
NVIDIA GeForce RTX 5070 Ti 16GB$6.64$1.66$2.23$46.75$0.78$0.83$74898
NVIDIA Geforce RTX 4070 12GB$6.01$1.50$1.90$29.16$0.69$0.75$35099
NVIDIA Geforce RTX 4070 Ti 12GB$4.99$1.25$1.67$33.33$0.79$0.62$40032
NVIDIA Geforce RTX 4080 16GB$7.80$1.91$2.50$47.50$1.06$0.97$760100