GPUs Ranked by Cost per FP16 TFLOPs

Something missing? Let us know and we'll add it if we can.

GPU$ / FP32 TFLOPs $ / FP16 TFLOPs $ / Tensor Core Count $ / Memory Capacity (GB) $ / Memory Bandwidth (GB/s) $ / Int8 TOPs Minimum PriceAvailable for Sale
NVIDIA T4 16GB$67.90$8.46$1.72$34.37$1.72$4.23$55097
NVIDIA A30 24GB$15.15$15.15$11.16$104.17$2.68$7.58$2,50035
NVIDIA A40 48GB$177.40$177.40$19.75$138.23$9.53$22.17$6,63522
NVIDIA A10 24GB$54.78$13.67$5.93$71.21$2.85$6.84$1,70966
NVIDIA L40 48GB$53.81$26.90$8.57$101.46$5.64$13.45$4,87032
AMD Radeon RX 7900 XT 20GB$13.94$7.04$4.32$36.25$0.91$7.04$72578
NVIDIA L4 24GB$16.66$8.26$8.33$83.32$6.67$4.12$2,00037
NVIDIA RTX A5000 24GB$49.41$49.41$5.36$57.17$1.79$3.09$1,37262
NVIDIA A100 PCIe 80GB$123.74$61.87$44.69$241.30$9.98$30.94$19,30415
NVIDIA Tesla P100 16GB$18.87$9.43$โˆž$12.50$0.27$โˆž$200100
NVIDIA Geforce RTX 4090 24GB$27.85$3.48$4.49$95.83$2.28$1.74$2,30099
NVIDIA Tesla V100 32GB$131.79$65.89$2.88$57.66$2.05$32.95$1,84536
NVIDIA H100 PCIe 80GB$36.72$18.35$60.87$346.97$13.61$9.17$27,75716
AMD Radeon RX 7900 XTX 24GB$14.75$7.32$4.69$37.50$0.94$7.32$90090
NVIDIA L40S 48GB$44.72$22.60$14.41$170.48$9.47$5.58$8,18326
NVIDIA Tesla V100 16GB$42.86$21.43$0.94$37.50$0.67$10.71$60049
AMD Radeon RX 7700 XT 12GB$16.38$8.19$5.31$47.77$1.33$โˆž$57340
AMD Radeon RX 7800 XT 16GB$16.16$8.08$4.98$37.38$0.96$โˆž$59855
AMD Radeon RX 7600 XT 16GB$19.49$9.75$6.87$27.50$1.53$โˆž$4407
NVIDIA GeForce RTX 5080 16GB$12.39$3.10$4.15$87.19$1.45$1.55$1,395100
NVIDIA GeForce RTX 5090 32GB$16.59$4.15$5.11$108.59$1.94$2.07$3,47557
NVIDIA GeForce RTX 5070 Ti 16GB$9.32$2.33$3.12$65.62$1.09$1.17$1,05084
NVIDIA Geforce RTX 4070 12GB$9.79$2.44$3.10$47.50$1.13$1.22$57064
NVIDIA Geforce RTX 4070 Ti 12GB$8.73$2.18$2.92$58.33$1.39$1.09$70042
NVIDIA Geforce RTX 4080 16GB$9.55$2.33$3.06$58.12$1.30$1.19$93078