NVIDIA L40S 48GB Specs, Benchmarks & Pricing

The NVIDIA L40S GPU was introduced in August 2023 (part number 900-2g133-0080-000). It is the successor to the NVIDIA L40 (part number 900-2G133-0010-000) and like the L40 is based on the AD102 chip from the Ada Lovelace architecture. Compared with the L40 it has nearly double the TF32 Tensor Core TFLOPS and FP16 Tensor Core performance, and increases the maximum power draw from 300W to 350W. It is targeted for generative AI and graphics and video applications. It lacks FP64 precision, but has great FP32, FP16 and mixed-precision performance. It uses the PCIe Gen4 x16 interconnect and Unlike the NVIDIA L4, it allows connecting monitors with 4x DisplayPort connectors.

Strengths

  • Excellent FP32 compute performance (top 3% of GPUs)
  • Excellent FP16 compute performance (top 11% of GPUs)

Specifications for NVIDIA L40S

SpecificationPerformance Ranking
FP32 TFLOPs
97th @ 183 TFLOPs (Top Tier)(Top)
FP16 TFLOPs
89th @ 362 TFLOPs (Top Tier)(Top)
Tensor Core Count
95th @ 568 Cores (Top Tier)(Top)
Memory Capacity (GB)
97th @ 48 GB (Top Tier)(Top)
Memory Bandwidth (GB/s)
81st @ 864 GB/s (Top Tier)(Top)
Int8 TOPs
96th @ 1466 TOPs (Top Tier)(Top)

Real-time NVIDIA L40S GPU Prices

We're tracking 17 of the NVIDIA L40S GPUs currently available for sale. The lowest average price is $9,066 (what's this?)
Buy Now

Compare Price/Performance to other GPUs

We track real-time prices of other GPUs too so that you can compare the price/performance of the NVIDIA L40S GPU to other GPUs.
Compare GPU Price/Performance

Compare NVIDIA L40S to Another GPU

Compare the NVIDIA L40S directly to another GPU to see specs, benchmarks, and prices side-by-side.
Compare GPUs Side-by-Side

Price History

NVIDIA L40S Price History

This chart tracks NVIDIA L40S prices over the past 6 months based on eBay listings. The green line shows the median price across all listings each day, while the yellow line shows the average of the three lowest-priced listings—a useful indicator for finding deals.

Trend: Over this period, the lowest average price has been up 26.8%. The current lowest average is $9,066, compared to a typical $8,553 over the period. The lowest average price is calculated as the average of the three lowest-priced listings each day.

gpupoet.com

Product Identifiers

Manufacturer Part Numbers (4)
NVIDIA Part Number
900-2G133-0080-000
NVIDIA Part Number
900-2G133-0180-030
NVIDIA Part Number
900-2G133-2780-030
Board ID
PG133G
Available from 6 Partners (9 products)
Dell
NVIDIA L40S Ada 48GB GDDR6 Passive AI GPU Graphics Card
7WK28(part number)
NVIDIA L40S GPU Accelerator 48GB
699-2G133-0242-L00(part number)
HPE
NVIDIA L40S 48GB PCIe Accelerator
S2L70C(part number)
Lenovo
ThinkSystem NVIDIA L40S 48GB PCIe Gen4 Passive GPU
4X67A90669(part number)
PNY
NVIDIA L40S 48GB GDDR6 PCIe 4.0 GPU
TCSL40SPCIE-PB(sku)
NVIDIA L40S 48GB GDDR6 PCIe Gen4 Passive GPU
NVL40STCGPU-KIT(sku)
Supermicro
NVIDIA Ada L40S 48GB GDDR6 PCIe 4.0 Graphics Card
GPU-NVL40S(part number)
Cisco
NVIDIA L40S 350W 48GB 2-slot FHFL GPU for UCS X-Series
UCSX-GPU-L40S(part number)
NVIDIA L40S 350W 48GB 2-slot FHFL GPU for UCS C-Series
UCSC-GPU-L40S(part number)

References

Notes

  1. fp32TFLOPS: MUCH higher compared to the L40 @ 90.5 per https://images.nvidia.com/content/Solutions/data-center/vgpu-L40-datasheet.pdf
  2. fp16TFLOPS: L40 is 181.05
  3. int8TOPS: From https://www.exxactcorp.com/blog/components/NVIDIA-L40S-GPU-Compared-to-A100-and-H100-Tensor-Core-GPU. L40 was 362 according to https://images.nvidia.com/aem-dam/Solutions/Data-Center/l4/nvidia-ada-gpu-architecture-whitepaper-v2.1.pdf
  4. Estimated MSRP of $45,000 USD for the NVIDIA L40S based on OEM list prices. NVIDIA does not publish official MSRP for data center GPUs. OEM list prices corroborated by 2 independent sources: Lenovo ThinkSystem NVIDIA L40S (4X67A90669) has MSRP of $51,579 per multioculus.com, and Cisco UCSX-GPU-L40S has MSRP of $39,094.50 per Bluum. The $45,000 estimate represents the midpoint of these OEM list prices. Note: Current market/resale prices (~$7,500) are significantly lower due to depreciation but do not reflect original launch list pricing.
  5. NVIDIA part number 900-2G133-0080-000 sourced from multiple vendor listings and official NVIDIA product documentation
  6. NVIDIA part number 900-2G133-0180-030 found at serverorbit.com and serversupply.com for L40S variant
  7. NVIDIA part number 900-2G133-2780-030 sourced from Lenovo ThinkSystem Product Guide (lenovopress.lenovo.com/lp1812.pdf) as the NVIDIA part number corresponding to Lenovo feature code BYFH
  8. Board ID PG133G sourced from Amazon and multiple vendor listings (amazon.com/dp/B0CLTDCZ82, newelltech.tech)
  9. Dell part number 7WK28 sourced from shop.bytestock.com and eBay listings
  10. Dell OEM part number 699-2G133-0242-L00 sourced from itcreations.com
  11. HPE part number S2L70C sourced from hpe.com official product catalog
  12. Lenovo part number 4X67A90669 sourced from Lenovo Press Product Guide (lenovopress.lenovo.com/lp1812.pdf)
  13. PNY SKU TCSL40SPCIE-PB sourced from pny.com/en-eu and esus-it.com
  14. PNY SKU NVL40STCGPU-KIT sourced from exxactcorp.com and serversupply.com
  15. Supermicro part number GPU-NVL40S sourced from store.supermicro.com official store
  16. Cisco part numbers UCSX-GPU-L40S and UCSC-GPU-L40S sourced from Cisco official datasheet (cisco.com) and provantage.com. UCSX is for UCS X-Series, UCSC is for UCS C-Series rack servers