GPUs Ranked by Cost per FP16 TFLOPs

Something missing? Let us know and we'll add it if we can.

GPU$ / FP32 TFLOPs $ / FP16 TFLOPs $ / Tensor Core Count $ / Memory Capacity (GB) $ / Memory Bandwidth (GB/s) $ / Int8 TOPs Minimum PriceAvailable for Sale
AMD Radeon RX 7600 XT 16GB$12.36$6.18$4.36$17.44$0.97$โˆž$27915
AMD Radeon RX 7700 XT 12GB$8.57$4.29$2.78$25.00$0.69$โˆž$30054
AMD Radeon RX 7800 XT 16GB$11.35$5.68$3.50$26.25$0.67$โˆž$42062
AMD Radeon RX 7900 XT 20GB$9.62$4.85$2.98$25.00$0.63$4.85$50085
AMD Radeon RX 7900 XTX 24GB$1.89$0.93$0.60$4.79$0.12$0.93$115100
NVIDIA A10 24GB$39.10$9.76$4.24$50.83$2.03$4.88$1,22074
NVIDIA A100 PCIe 80GB$59.29$29.65$21.41$115.63$4.78$14.82$9,25017
NVIDIA A30 24GB$17.58$17.58$12.95$120.83$3.11$8.79$2,90052
NVIDIA A40 48GB$115.06$115.06$12.81$89.65$6.18$14.38$4,30334
NVIDIA Geforce RTX 4070 Ti 12GB$6.85$1.71$2.29$45.79$1.09$0.86$55048
NVIDIA Geforce RTX 4070 12GB$6.87$1.72$2.17$33.33$0.79$0.86$40080
NVIDIA Geforce RTX 4080 16GB$7.80$1.91$2.50$47.50$1.06$0.97$760100
NVIDIA Geforce RTX 4090 24GB$25.42$3.18$4.10$87.50$2.08$1.59$2,10099
NVIDIA GeForce RTX 5070 Ti 16GB$6.84$1.71$2.29$48.12$0.80$0.86$770100
NVIDIA GeForce RTX 5080 16GB$8.44$2.11$2.83$59.38$0.99$1.06$95099
NVIDIA H100 PCIe 80GB$36.46$18.22$60.45$344.58$13.52$9.11$27,56612
NVIDIA L4 24GB$16.63$8.25$8.32$83.17$6.65$4.12$1,99649
NVIDIA L40 48GB$77.34$38.66$12.32$145.81$8.10$19.33$6,99924
NVIDIA L40S 48GB$42.07$21.27$13.55$160.40$8.91$5.25$7,69938
NVIDIA RTX A5000 24GB$53.29$53.29$5.78$61.67$1.93$3.33$1,48072
NVIDIA T4 16GB$9.88$1.23$0.25$5.00$0.25$0.62$8094
NVIDIA Tesla P100 16GB$8.49$4.25$โˆž$5.63$0.12$โˆž$90100
NVIDIA Tesla V100 16GB$20.00$10.00$0.44$17.50$0.31$5.00$28071
NVIDIA Tesla V100 32GB$50.00$25.00$1.09$21.87$0.78$12.50$70061
NVIDIA GeForce RTX 5090 32GB$12.17$3.04$3.75$79.68$1.42$1.52$2,55099