NVIDIA L40 48GB Specs, Benchmarks & Pricing

The NVIDIA L40 GPU was introduced in September 2022 with part number 900-2G133-0010-000. It is based on the AD102 chip from the Ada Lovelace architecture. It is optimized for graphics and AI-enabled 2D, video and 3D image generation. It uses the PCIe Gen4 x16 interconnect and Unlike the NVIDIA L4, it allows connecting monitors with 4x DisplayPort connectors.

Strengths

  • Excellent FP32 compute performance (top 15% of GPUs)
  • Excellent tensor core count (top 5% of GPUs)

Specifications for NVIDIA L40

SpecificationPerformance Ranking
FP32 TFLOPs
85th @ 90.5 TFLOPs (Top Tier)(Top)
FP16 TFLOPs
72nd @ 181.05 TFLOPs (Mid Tier)(Mid)
Tensor Core Count
95th @ 568 Cores (Top Tier)(Top)
Memory Capacity (GB)
97th @ 48 GB (Top Tier)(Top)
Memory Bandwidth (GB/s)
81st @ 864 GB/s (Top Tier)(Top)
Int8 TOPs
51st @ 362 TOPs (Mid Tier)(Mid)

Real-time NVIDIA L40 GPU Prices

We're tracking 38 of the NVIDIA L40 GPUs currently available for sale. The lowest average price is $7,266 (what's this?)
Buy Now

Compare Price/Performance to other GPUs

We track real-time prices of other GPUs too so that you can compare the price/performance of the NVIDIA L40 GPU to other GPUs.
Compare GPU Price/Performance

Compare NVIDIA L40 to Another GPU

Compare the NVIDIA L40 directly to another GPU to see specs, benchmarks, and prices side-by-side.
Compare GPUs Side-by-Side

Price History

NVIDIA L40 Price History

This chart tracks NVIDIA L40 prices over the past 6 months based on eBay listings. The green line shows the median price across all listings each day, while the yellow line shows the average of the three lowest-priced listings—a useful indicator for finding deals.

Trend: Over this period, the lowest average price has been up 21.1%. The current lowest average is $7,266, compared to a typical $8,178 over the period. The lowest average price is calculated as the average of the three lowest-priced listings each day.

gpupoet.com

Product Identifiers

Manufacturer Part Numbers (4)
NVIDIA Part Number
900-2G133-0010-000
Product SKU
PG133 SKU 250
Board ID
PG133
NVIDIA Part Number
699-2G133-0250-xxx
Available from 5 Partners (8 products)
Dell
NVIDIA L40 48GB DW Passive Cooling FH PCIe Accelerator
20FCY(part number)
NVIDIA L40 GPU Accelerator 48GB
699-2G133-0250-L00(part number)
NVIDIA L40 300W 48GB Passive Double Wide Full Height GPU
490-BJHN(sku)
HPE
NVIDIA L40 48GB PCIe Accelerator for HPE
S0K90C(part number)
Lenovo
ThinkSystem NVIDIA L40 48GB PCIe Gen4 Passive GPU
4X67A84823(part number)
PNY
NVIDIA L40 Graphic Card - 48 GB GDDR6
NVL40TCGPU-KIT(sku)
Cisco
NVIDIA L40 300W 48GB 2-slot GPU for UCS C-Series
UCSC-GPU-L40(part number)
NVIDIA L40 300W 48GB GPU for UCS X-Series
UCSX-GPU-L40(part number)

References

Notes

  1. fp32TFLOPS: the L40 @ 90.5 per https://images.nvidia.com/content/Solutions/data-center/vgpu-L40-datasheet.pdf
  2. fp16TFLOPS: L40 is 181.05
  3. int8TOPS: L40 was 362 according to https://images.nvidia.com/aem-dam/Solutions/Data-Center/l4/nvidia-ada-gpu-architecture-whitepaper-v2.1.pdf
  4. Estimated MSRP of $31,000 USD for the NVIDIA L40 based on OEM list prices. NVIDIA does not publish official MSRP for data center GPUs. OEM list prices corroborated by 2 independent sources: Lenovo ThinkSystem NVIDIA L40 (4X67A84823) has MSRP of $33,109 per lenovo.com, and Cisco UCSX-GPU-L40 has GPL list price of approximately $30,000 per itprice.com. The $31,000 estimate represents the midpoint of these OEM list prices. Note: Current market/resale prices (~$7,500) are significantly lower due to depreciation but do not reflect original launch list pricing.
  5. NVIDIA part number (NVPN) 900-2G133-0010-000 sourced from NVIDIA official L40 datasheet and product brief
  6. Product SKU 'PG133 SKU 250' sourced from NVIDIA official product brief at nvidia.com/content/dam/en-zz/Solutions/Data-Center/datasheets/L-40/product-brief-L40.pdf and videocardz.net
  7. Board ID PG133 sourced from NVIDIA official documentation
  8. NVIDIA reference design part number 699-2G133-0250-xxx sourced from videocardz.net and multiple OEM listings
  9. Dell part number 20FCY sourced from shop.bytestock.com and expresscomputersystems.com
  10. Dell OEM part number 699-2G133-0250-L00 sourced from shop.bytestock.com and itcreations.com
  11. Dell SKU 490-BJHN sourced from Dell official store (dell.com) and itcreations.com
  12. HPE part number S0K90C sourced from HPE official store (buy.hpe.com)
  13. Lenovo part number 4X67A84823 sourced from Lenovo official product page (lenovo.com) and Lenovo Press Product Guide
  14. PNY SKU NVL40TCGPU-KIT sourced from CDW.com and pny.com
  15. Cisco part numbers UCSC-GPU-L40 and UCSX-GPU-L40 sourced from Cisco official datasheet (cisco.com) and provantage.com. UCSC is for UCS C-Series rack servers, UCSX is for UCS X-Series modular systems