NVIDIA RTX 4090 24GB Specifications for AI Enthusiasts
The NVIDIA GeForce RTX 4090 is a graphics card released in 2023, featuring the latest Ada Lovelace architecture. While primarily aimed at gamers, the RTX 4090 also offers impressive capabilities for machine learning tasks, particularly inference and training workloads that benefit from its large memory and high core count. It uses a PCI-Express 4.0 x16 host interface
- GPU Architecture: ada
- Hardware-Accelerated GEMM Operations:FP16 FP32 BF16 FP8 INT8 INT4 TF32 FP64 INT1
- CUDA Compute Capability : 8.9
Specifications for NVIDIA RTX 4090
| Raw Performance | |
|---|---|
| Tensor Core Count: 512 | |
| FP32 TFLOPs: 82.6 | |
| FP16 TFLOPs: 330.3 | |
| Int8 TOPs: 660.6 | |
| Memory Capacity (GB): 24 | |
| Memory Bandwidth (GB/s): 1008 |
Real-time NVIDIA RTX 4090 GPU Prices
We're tracking 92 of the NVIDIA RTX 4090 GPUs currently available for sale. The lowest price is $799
Buy NowCompare Price/Performance to other GPUs
We track real-time prices of other GPUs too so that you can compare the price/performance of the NVIDIA RTX 4090 GPU to other GPUs.
Compare GPU Price/PerformanceReferences
- https://images.nvidia.com/aem-dam/Solutions/Data-Center/l4/nvidia-ada-gpu-architecture-whitepaper-v2.1.pdf
- https://www.nvidia.com/en-us/geforce/graphics-cards/40-series/rtx-4090/
- https://images.nvidia.com/aem-dam/Solutions/geforce/ada/nvidia-ada-gpu-architecture.pdf
- https://lambdalabs.com/blog/nvidia-rtx-4090-vs-rtx-3090-deep-learning-benchmark