Regularization ·
L1 vs L2
un
seel
.com · Weight penalty · Sparsity · Shrinkage
Penalty
—
Zeroed weights
0
State
—
L2 region (circle)
L1 region (diamond)
Loss contour
Surviving weight
▶ Play
←
→
🔇 Unmute
Reset
Un
seel
.com · Regularization