[KongchangAI]
ConceptLayer Normalization / LayerNorm / LN

Layer Normalization

A neural network normalization technique that standardizes activations to zero mean and unit variance across the feature dimension for each sample. It stabilizes activation values across layers and is widely used to improve training stability in Transformer and other sequence models.

Timeline (last 90 days)

Sep 11

Layer normalization standardizes each sample across the feature dimension to zero mean and unit variance

Unverified50%

All Facts (2)

Source Articles