GPUs Ranked by Cost per Tensor Core Count
Something missing? Let us know and we'll add it if we can.
GPU | $ / FP32 TFLOPs | $ / FP16 TFLOPs | $ / Tensor Core Count | $ / Memory Capacity (GB) | $ / Memory Bandwidth (GB/s) | $ / Int8 TOPs | Minimum Price | Available for Sale |
---|---|---|---|---|---|---|---|---|
NVIDIA T4 16GB | $67.90 | $8.46 | $1.72 | $34.38 | $1.72 | $4.23 | $550 | 86 |
NVIDIA A30 24GB | $13.94 | $13.94 | $10.27 | $95.83 | $2.46 | $6.97 | $2,300 | 44 |
NVIDIA A40 48GB | $140.37 | $140.37 | $15.63 | $109.38 | $7.54 | $17.54 | $5,250 | 29 |
NVIDIA A10 24GB | $44.84 | $11.19 | $4.86 | $58.29 | $2.33 | $5.60 | $1,399 | 68 |
NVIDIA L40 48GB | $55.24 | $27.61 | $8.80 | $104.15 | $5.79 | $13.81 | $4,999 | 28 |
AMD Radeon RX 7900 XT 20GB | $11.44 | $5.78 | $3.54 | $29.75 | $0.74 | $5.78 | $595 | 91 |
NVIDIA L4 24GB | $15.63 | $7.75 | $7.81 | $78.13 | $6.25 | $3.87 | $1,875 | 55 |
NVIDIA RTX A5000 24GB | $46.74 | $46.74 | $5.07 | $54.08 | $1.69 | $2.92 | $1,298 | 85 |
NVIDIA A100 PCIe 80GB | $67.29 | $33.65 | $24.30 | $131.23 | $5.43 | $16.82 | $10,498 | 11 |
NVIDIA Tesla P100 16GB | $10.85 | $5.42 | $โ | $7.19 | $0.16 | $โ | $115 | 100 |
NVIDIA Geforce RTX 4090 24GB | $26.63 | $3.33 | $4.30 | $91.67 | $2.18 | $1.67 | $2,200 | 99 |
NVIDIA Tesla V100 32GB | $76.86 | $38.43 | $1.68 | $33.63 | $1.20 | $19.22 | $1,076 | 51 |
NVIDIA H100 PCIe 80GB | $36.55 | $18.26 | $60.59 | $345.37 | $13.55 | $9.13 | $27,630 | 10 |
AMD Radeon RX 7900 XTX 24GB | $12.46 | $6.18 | $3.96 | $31.67 | $0.79 | $6.18 | $760 | 99 |
NVIDIA L40S 48GB | $41.12 | $20.79 | $13.25 | $156.77 | $8.71 | $5.13 | $7,525 | 30 |
NVIDIA Tesla V100 16GB | $26.70 | $13.35 | $0.58 | $23.36 | $0.42 | $6.68 | $374 | 60 |
AMD Radeon RX 7700 XT 12GB | $9.29 | $4.64 | $3.01 | $27.08 | $0.75 | $โ | $325 | 66 |
AMD Radeon RX 7800 XT 16GB | $13.19 | $6.59 | $4.07 | $30.50 | $0.78 | $โ | $488 | 79 |
AMD Radeon RX 7600 XT 16GB | $13.29 | $6.65 | $4.69 | $18.75 | $1.04 | $โ | $300 | 21 |
NVIDIA GeForce RTX 5080 16GB | $8.87 | $2.22 | $2.97 | $62.44 | $1.04 | $1.11 | $999 | 100 |
NVIDIA GeForce RTX 5090 32GB | $11.45 | $2.86 | $3.53 | $74.97 | $1.34 | $1.43 | $2,399 | 100 |
NVIDIA GeForce RTX 5070 Ti 16GB | $7.02 | $1.75 | $2.35 | $49.37 | $0.82 | $0.88 | $790 | 99 |
NVIDIA Geforce RTX 4070 12GB | $7.39 | $1.84 | $2.34 | $35.83 | $0.85 | $0.92 | $430 | 100 |
NVIDIA Geforce RTX 4070 Ti 12GB | $7.22 | $1.80 | $2.41 | $48.25 | $1.15 | $0.90 | $579 | 30 |
NVIDIA Geforce RTX 4080 16GB | $8.73 | $2.13 | $2.80 | $53.13 | $1.19 | $1.09 | $850 | 98 |