GPUs Ranked by Cost per FP16 TFLOPs

Something missing? Let us know and we'll add it if we can.

GPU$ / FP32 TFLOPs $ / FP16 TFLOPs $ / Tensor Core Count $ / Memory Capacity (GB) $ / Memory Bandwidth (GB/s) $ / Int8 TOPs Minimum PriceAvailable for Sale
NVIDIA T4 16GB$67.90$8.46$1.72$34.38$1.72$4.23$55087
NVIDIA A30 24GB$19.27$19.27$14.20$132.50$3.41$9.64$3,18044
NVIDIA A40 48GB$112.30$112.30$12.50$87.50$6.03$14.03$4,20035
NVIDIA A10 24GB$44.23$11.04$4.79$57.50$2.30$5.52$1,38064
NVIDIA L40 48GB$59.12$29.55$9.42$111.46$6.19$14.78$5,35028
AMD Radeon RX 7900 XT 20GB$9.62$4.85$2.98$25.00$0.63$4.85$50092
NVIDIA L4 24GB$15.42$7.64$7.71$77.08$6.17$3.81$1,85051
NVIDIA RTX A5000 24GB$53.98$53.98$5.86$62.46$1.95$3.37$1,49977
NVIDIA A100 PCIe 80GB$66.99$33.49$24.19$130.63$5.40$16.75$10,45012
NVIDIA Tesla P100 16GB$9.24$4.62$โˆž$6.12$0.13$โˆž$9898
NVIDIA Geforce RTX 4090 24GB$0.96$0.12$0.15$3.29$0.08$0.06$7999
NVIDIA Tesla V100 32GB$71.36$35.68$1.56$31.22$1.11$17.84$99956
NVIDIA H100 PCIe 80GB$36.91$18.44$61.19$348.81$13.69$9.22$27,90510
AMD Radeon RX 7900 XTX 24GB$10.64$5.28$3.38$27.04$0.68$5.28$649100
NVIDIA L40S 48GB$38.25$19.34$12.32$145.83$8.10$4.77$7,00036
NVIDIA Tesla V100 16GB$23.57$11.79$0.52$20.63$0.37$5.89$33064
AMD Radeon RX 7700 XT 12GB$10.71$5.36$3.47$31.25$0.87$โˆž$37551
AMD Radeon RX 7800 XT 16GB$11.89$5.95$3.67$27.50$0.71$โˆž$44071
AMD Radeon RX 7600 XT 16GB$14.18$7.09$5.00$20.00$1.11$โˆž$32015
NVIDIA GeForce RTX 5080 16GB$8.26$2.07$2.77$58.12$0.97$1.03$93098
NVIDIA GeForce RTX 5090 32GB$11.22$2.80$3.46$73.44$1.31$1.40$2,350100
NVIDIA GeForce RTX 5070 Ti 16GB$6.57$1.64$2.20$46.22$0.77$0.82$740100
NVIDIA Geforce RTX 4070 12GB$7.39$1.84$2.34$35.83$0.85$0.92$430100
NVIDIA Geforce RTX 4070 Ti 12GB$7.22$1.80$2.41$48.25$1.15$0.90$57934
NVIDIA Geforce RTX 4080 16GB$8.01$1.96$2.57$48.75$1.09$1.00$78096