Layer Normalization · One Sample, d Features
unseel.com · Normalize across features · O(d) per token
μ —
σ² —
Step —
Feature xᵢ
Mean μ line
Normalized x̂
Output y = γx̂+β
Unseel.com · Layer Normalization Unseel.com · Layer Normalization: Per-Sample Feature Normalization for Sequence Models