NVIDIA H100 PCIe 80GB Specs, Benchmarks & Pricing
The NVIDIA H100 PCIe 80GB is a professional graphics card designed primarily for machine learning and high-performance computing applications. Launched in March 2023, it is built on the innovative Hopper GH100 architecture and utilizes the 4 nm process by TSMC. The H100 PCIe 80GB stands out for its substantial memory capacity and high-speed memory bandwidth, making it exceptionally suitable for handling large datasets and complex machine learning models. Its tensor cores significantly accelerate machine learning operations. The Hopper architecture, as seen in the H100 and H200 GPUs, introduces several technological innovations aimed at enhancing performance in AI training and inference. These GPUs are distinguished by their massive transistor count and advanced memory technologies, like HBM3 and HBM2e, supporting up to 80 GB of memory. The H100 supports HBM2e memory, while the H200 supports the faster HBM3 memory system, which can deliver up to 3 TB/s, a significant increase over the previous generation's capabilities. A common nvidia part number for this card is 900-21010-000-000.
- Release Date: March 21, 2023
- MSRP: $98,000 USD
- GPU Architecture: hopper
- Hardware-Accelerated GEMM Operations:FP16 FP32 BF16 FP8 INT8 INT4 TF32 FP64 INT1
- CUDA Compute Capability : 9
Strengths
- Excellent FP32 compute performance (top 0% of GPUs)
- Excellent FP16 compute performance (top 0% of GPUs)
Specifications for NVIDIA H100 PCIe
| Specification | Performance Ranking |
|---|---|
| FP32 TFLOPs | |
| FP16 TFLOPs | |
| Tensor Core Count | |
| Memory Capacity (GB) | |
| Memory Bandwidth (GB/s) | |
| Int8 TOPs |
Real-time NVIDIA H100 PCIe GPU Prices
Compare Price/Performance to other GPUs
Compare NVIDIA H100 PCIe to Another GPU
Price History
NVIDIA H100 PCIe Price History
This chart tracks NVIDIA H100 PCIe prices over the past 6 months based on eBay listings. The green line shows the median price across all listings each day, while the yellow line shows the average of the three lowest-priced listings—a useful indicator for finding deals.
Trend: Over this period, the lowest average price has been relatively stable. The current lowest average is $28,852, compared to a typical $28,217 over the period. The lowest average price is calculated as the average of the three lowest-priced listings each day.
Product Identifiers
Manufacturer Part Numbers (3)
- NVIDIA Part Number
- 900-21010-0000-000
- Product SKU
- P1010 SKU 200
- NVIDIA Part Number
- 699-21010-0200-xxx
Available from 7 Partners (15 products)
- NVIDIA H100 PCIe Tensor Core GPU 80GB
- DGP4C(part number)
- NVIDIA H100 PCIe Tensor Core GPU 80GB with Passive Heatsink
- DP44G(part number)
- NVIDIA H100 PCIe Tensor Core GPU 80GB
- 900-21010-0100-030-DELL(part number)
- NVIDIA H100 80GB PCIe Accelerator for HPE
- R9S41C(part number)
- NVIDIA H100 PCIe Tensor Core GPU 80GB
- P54751-001(part number)
- NVIDIA H100 Tensor Core GPU 80GB PCIe
- NVH100TCGPU-KIT(sku)
- NVIDIA H100 Tensor Core GPU 80GB PCIe Retail
- XNVH100TCGPU-KIT-RETAIL(sku)
- NVIDIA H100 80GB PCIe 5.0 x16 Passive Cooling
- GPU-NVH100-80(part number)
- NVIDIA H100 80GB PCIe 5.0 x16 Passive Cooling
- GPU-NVH800-80(part number)
- NVIDIA H100 80GB GPU PCIe 5.0
- 699-21010-0200-600(part number)
- ThinkSystem NVIDIA H100 80GB PCIe Gen5 Passive GPU
- 4X67A82257(part number)
- NVIDIA H100 PCIe 350W 80GB 2-Slot FHFL GPU
- UCSC-GPU-H100(part number)
- NVIDIA H100 350W 80GB 2-Slot FHFL GPU
- UCSC-GPU-H100-80(part number)
- NVIDIA H100 350W 80GB 2-Slot FHFL GPU (Spare)
- UCSC-GPU-H100-80=(part number)
- Cisco UCS NVIDIA H100 80GB Passive 350W DW FH/HL GPU
- UCSX-GPU-H100-80(part number)
References
- https://resources.nvidia.com/en-us-tensor-core/nvidia-tensor-core-gpu-datasheet
- https://www.nvidia.com/en-us/data-center/h100/
- https://www.techpowerup.com/gpu-specs/h100-pcie-80-gb.c3899
- https://en.wikipedia.org/wiki/Hopper_(microarchitecture)
- https://www.nvidia.com/en-us/data-center/technologies/hopper-architecture/
- https://www.nvidia.com/en-us/data-center/tensor-cores/
- https://www.shopblt.com/item/lenovo-thinksystem-nvidia-h100-80gb-pcie/lenovo_4x67a82257.html
- https://www.tech-america.com/item/cisco-nvidia-h100-graphic-card/ucsc-gpu-h100-80
- https://www.cdw.com/product/nvidia-h100-gpu-computing-processor-nvidia-h100-tensor-core-80-gb/8268491
- https://www.serversupply.com/GPU/HBM2E/80GB/NVIDIA/900-21010-0000-000_387928.htm
- https://www.itcreations.com/product/140934
- https://www.itcreations.com/product/149409
- https://www.hpe.com/us/en/product-catalog/options/pip.specifications.nvidia-accelerators.1014716083.html
- https://buy.hpe.com/us/en/Options/Server-Accelerators/Computational-and-Graphics-Accelerators-for-Servers/Computational-and-Graphics-Accelerators-with-HPE/NVIDIA-H100-80GB-PCIe-Accelerator-for-HPE/p/R9S41C
- https://www.itcreations.com/product/146020
- https://www.centralcomputer.com/pny-nvidia-h100-tensor-core-gpu-accelerator-80gb-hbm2e-nvh100tcgpu-kit.html
- https://www.itcreations.com/product/146438
- https://www.renewtech.com/supermicro-699-21010-0200-600.html
- https://www.ahead-it.eu/en/shop/hardware/supermicro/supermicro-gpu-nvh100-80-nr-nvidia-h100-80gb-pcie-5-0-x16-passive-cooling
- https://lenovopress.lenovo.com/lp1732-thinksystem-nvidia-h100-pcie-gen5-gpu
- https://serverproven.lenovo.com/option/4X67A82257/
- https://www.itcreations.com/product/145735
- https://www.provantage.com/cisco-systems-ucsc-gpu-h100-80~4CSC651P.htm
- https://www.connection.com/product/cisco-nvidia-h100-pcie-graphics-card-80gb/ucsc-gpu-h100-80/41789563
- https://expresscomputersystems.com/products/cisco-ucs-nvidia-h100-80gb-passive-350w-dw-fh-hl-gpu-ucsx-gpu-h100-80
- https://www.nvidia.com/content/dam/en-zz/Solutions/gtcs22/data-center/h100/PB-11133-001_v01.pdf
- https://server2u.com/shop/900-21010-0000-000-900-21010-0300-030-nvidia-h100-pcie-80gb-60144
Notes
- fp32TFLOPS: NOTE: FP32 Tensor Core
- fp16TFLOPS: NOTE: FP16 Tensor Core
- int8TOPS: NOTE: INT8 Tensor Core
- Estimated MSRP of $98,000 USD for H100 80GB PCIe based on OEM list prices. NVIDIA does not publish official MSRP for data center GPUs. OEM list prices corroborated by 3 independent sources: CDW lists Cisco UCSC-GPU-H100-80= at $103,085.66, Tech-America lists Cisco UCSC-GPU-H100-80 MSRP at $99,696, and ShopBLT lists Lenovo 4X67A82257 at $90,935. The $98,000 estimate represents the average of these OEM list prices. H100 pricing varies by form factor (PCIe vs SXM) and memory size (80GB vs 96GB).
- Manufacturer identifiers sourced from NVIDIA official documentation and OEM product listings. Primary NVPN 900-21010-0000-000 confirmed across multiple resellers. Product SKU P1010 SKU 200 and alternate NVPN 699-21010-0200-xxx found in NVIDIA product briefs and OEM documentation.
- Third-party product identifiers sourced from official OEM websites and authorized reseller listings. Dell part numbers (DGP4C, DP44G, 900-21010-0100-030-DELL) from ITCreations and Express Computer Systems. HPE part number (R9S41C) from HPE official product catalog. HP part number (P54751-001) from ITCreations. PNY SKUs (NVH100TCGPU-KIT, XNVH100TCGPU-KIT-RETAIL) from Central Computer and ITCreations. Supermicro OEM part numbers (GPU-NVH100-80, GPU-NVH800-80, 699-21010-0200-600) from Ahead-IT and Renewtech. Lenovo part number (4X67A82257) from Lenovo Press and ServerProven. Cisco part numbers (UCSC-GPU-H100, UCSC-GPU-H100-80, UCSC-GPU-H100-80=, UCSX-GPU-H100-80) from Provantage, Connection, and Express Computer Systems.
- Note: Part number 900-21010-0300-030 is a variant SKU found in some reseller listings but specific differences from 900-21010-0000-000 are not documented in available sources.