Loading the catalog…
NVIDIA L4 (NVIDIA)
Blurred values are subscriber-only. Sign in to start a free trial — 2 full pages a day — or subscribe for unlimited access.
| Memory Bandwidth Tb S | 0.3 |
|---|---|
| Fp8 Tflops Dense | 242.5 |
| Interconnect | PCIe Gen4 x16 64GB/s |
| Fp32 Tflops | 30.3 |
| Tdp W | 72 |
| Gpu Memory Gb | 24 |
| Accelerator Form Factor | PCIe |
| Architecture | Ada Lovelace |
| Fp16 Bf16 Tflops Dense | 121 |
| Fp16 Bf16 Tflops Sparse | 242 |
| Int8 Tops Dense | 242.5 |
| Fp8 Tflops Sparse | |
| Int8 Tops Sparse | |
| Media Engines | |
| Product Name | |
| Tf32 Tflops Dense | |
| Tf32 Tflops Sparse |
| SKU | NVIDIA L4 |
|---|
| Tagline | |
|---|---|
| AI video performance vs CPU | |
| Generative AI performance | |
| Graphics performance vs previous GPU generation | |
| Form factor (described) | |
| Up to 120X Higher AI Video Performance - L4 AI Video Performance | |
| AI Video Performance measurement basis | |
| 2.5X Higher Generative AI Performance - L4 Generative AI Performance | |
| Generative AI Performance measurement basis | |
| RT Cores generation | |
| Ray-triangle intersection throughput (RT Cores) | |
| RT-TFLOP performance increase | |
| Shader Execution Reordering (SER) performance improvement | |
| Over 4X Higher Real-Time Rendering Performance - Omniverse (with DLSS 3) | |
| Over 3X Higher Ray-Tracing Performance - Gaming (with DLSS 3) | |
| Visual Computing Performance measurement basis | |
| Tensor Cores generation | |
| Tensor Core precisions | |
| Inference performance over previous generation (FP8 vs T4 FP16) | |
| GPU memory vs previous generation | |
| Workstation performance increase (vWS) | |
| Video encoders | |
| Video format | |
| Concurrent video streams per L4 server | |
| AI video end-to-end pipeline performance vs CPU | |
| JPEG decoders | |
| Security | |
| Applications accelerated by platform | |
| AI video performance (efficiency context) | |
| Energy efficiency improvement vs CPU | |
| Energy savings (2MW data center CPU-to-L4 switch) homes powered | |
| Energy savings carbon offset equivalent | |
| Enterprise software | |
| BFLOAT16 Tensor Core | |
| INT8 Tensor Core | |
| NVENC | NVDEC | JPEG Decoders | |
| Server Options | |
| Specifications note | |
| Document part number | |
| Copyright |
