NVIDIA RTX 4000 Ada Generation 20GB Specifications for AI Enthusiasts
The NVIDIA RTX 4000 Ada Generation is a professional single-slot workstation GPU released in August 2023, built on the Ada Lovelace architecture using the AD104 chip with TSMC's 5nm process. It features 6,144 CUDA cores, 192 fourth-generation Tensor Cores, and 48 third-generation RT Cores, paired with 20GB of GDDR6 ECC memory. The fourth-generation Tensor Cores introduce FP8 precision support and deliver up to 3X AI performance improvement over the previous Ampere generation, with 427.6 TFLOPS of tensor performance using sparsity. The card's tensor cores support multiple precision formats including FP8 (in both E4M3 and E5M2 formats), TF32, BF16, FP16, INT8, and INT4, making it highly versatile for AI inference and machine learning workloads. With a TDP of only 130W in a single-slot form factor, the RTX 4000 Ada offers exceptional power efficiency for professional visualization, 3D rendering, and AI applications. The GPU includes two eighth-generation NVENC encoders with AV1 support (40% more efficient than H.264) and two fifth-generation NVDEC decoders. Memory bandwidth of 360 GB/s is provided through a 160-bit memory interface running at 18 Gbps effective speed. With PCI Express 4.0 x16 interface and four DisplayPort 1.4a outputs, it delivers up to 1.7X higher performance than the previous generation RTX A4000.
- Release Date: August 9, 2023
- GPU Architecture: ada
- Hardware-Accelerated GEMM Operations:FP16 FP32 BF16 FP8 INT8 INT4 TF32 FP64 INT1
- CUDA Compute Capability : 8.9
Specifications for NVIDIA RTX 4000 Ada Generation
| Raw Performance | |
|---|---|
| FP32 TFLOPs: 26.7 | |
| FP16 TFLOPs: 213.8 | |
| Tensor Core Count: 192 | |
| Memory Capacity (GB): 20 | |
| Memory Bandwidth (GB/s): 360 | |
| Int8 TOPs: 427.6 |
Real-time NVIDIA RTX 4000 Ada Generation GPU Prices
Compare Price/Performance to other GPUs
References
- https://www.nvidia.com/en-us/products/workstations/rtx-4000/
- https://www.techpowerup.com/gpu-specs/rtx-4000-ada-generation.c4171
- https://lenovopress.lenovo.com/lp2144-thinksystem-nvidia-rtx-4000-ada-20gb-pcie-active-gpu
- https://www.leadtek.com/eng/products/workstation_graphics(2)/NVIDIA_RTX_4000_Ada_Generation(40988)/detail
- https://images.nvidia.com/aem-dam/en-zz/Solutions/technologies/NVIDIA-ADA-GPU-PROVIZ-Architecture-Whitepaper_1.1.pdf