GPUs Ranked by Cost per FP16 TFLOPs
Something missing? Let us know and we'll add it if we can.
GPU | $ / FP32 TFLOPs | $ / FP16 TFLOPs | $ / Tensor Core Count | $ / Memory Capacity (GB) | $ / Memory Bandwidth (GB/s) | $ / Int8 TOPs | Minimum Price | Available for Sale |
---|---|---|---|---|---|---|---|---|
NVIDIA T4 16GB | $64.20 | $8.00 | $1.63 | $32.50 | $1.63 | $4.00 | $520 | 81 |
NVIDIA A30 24GB | $14.55 | $14.55 | $10.71 | $100.00 | $2.57 | $7.27 | $2,400 | 34 |
NVIDIA A40 48GB | $160.43 | $160.43 | $17.86 | $125.00 | $8.62 | $20.05 | $6,000 | 27 |
NVIDIA A10 24GB | $41.63 | $10.39 | $4.51 | $54.13 | $2.17 | $5.20 | $1,299 | 67 |
NVIDIA L40 48GB | $60.50 | $30.24 | $9.64 | $114.06 | $6.34 | $15.12 | $5,475 | 27 |
AMD Radeon RX 7900 XT 20GB | $9.85 | $4.97 | $3.05 | $25.60 | $0.64 | $4.97 | $512 | 70 |
NVIDIA L4 24GB | $17.29 | $8.57 | $8.65 | $86.46 | $6.92 | $4.28 | $2,075 | 46 |
NVIDIA RTX A5000 24GB | $46.78 | $46.78 | $5.07 | $54.13 | $1.69 | $2.92 | $1,299 | 72 |
NVIDIA A100 PCIe 80GB | $76.92 | $38.46 | $27.78 | $149.99 | $6.20 | $19.23 | $11,999 | 9 |
NVIDIA Tesla P100 16GB | $14.15 | $7.07 | $โ | $9.37 | $0.20 | $โ | $150 | 100 |
NVIDIA Geforce RTX 4090 24GB | $25.42 | $3.18 | $4.10 | $87.50 | $2.08 | $1.59 | $2,100 | 100 |
NVIDIA Tesla V100 32GB | $114.29 | $57.14 | $2.50 | $50.00 | $1.78 | $28.57 | $1,600 | 34 |
NVIDIA H100 PCIe 80GB | $37.12 | $18.55 | $61.55 | $350.82 | $13.76 | $9.27 | $28,066 | 7 |
AMD Radeon RX 7900 XTX 24GB | $13.11 | $6.50 | $4.17 | $33.33 | $0.83 | $6.50 | $800 | 100 |
NVIDIA L40S 48GB | $44.72 | $22.60 | $14.41 | $170.48 | $9.47 | $5.58 | $8,183 | 24 |
NVIDIA Tesla V100 16GB | $32.14 | $16.07 | $0.70 | $28.12 | $0.50 | $8.04 | $450 | 57 |
AMD Radeon RX 7700 XT 12GB | $11.43 | $5.71 | $3.70 | $33.33 | $0.93 | $โ | $400 | 54 |
AMD Radeon RX 7800 XT 16GB | $13.95 | $6.97 | $4.30 | $32.25 | $0.83 | $โ | $516 | 66 |
AMD Radeon RX 7600 XT 16GB | $14.18 | $7.09 | $5.00 | $20.00 | $1.11 | $โ | $320 | 10 |
NVIDIA GeForce RTX 5080 16GB | $10.66 | $2.67 | $3.57 | $75.00 | $1.25 | $1.33 | $1,200 | 99 |
NVIDIA GeForce RTX 5090 32GB | $12.49 | $3.12 | $3.85 | $81.79 | $1.46 | $1.56 | $2,617 | 99 |
NVIDIA GeForce RTX 5070 Ti 16GB | $7.54 | $1.89 | $2.53 | $53.06 | $0.88 | $0.94 | $849 | 100 |
NVIDIA Geforce RTX 4070 12GB | $8.33 | $2.08 | $2.64 | $40.42 | $0.96 | $1.04 | $485 | 97 |
NVIDIA Geforce RTX 4070 Ti 12GB | $7.85 | $1.96 | $2.62 | $52.50 | $1.25 | $0.98 | $630 | 25 |
NVIDIA Geforce RTX 4080 16GB | $9.45 | $2.31 | $3.03 | $57.50 | $1.28 | $1.18 | $920 | 95 |