Vanishing Gradient · Deep Net Backprop
unseel.com · Sigmoid 0.25ˣ · ReLU · ResNet skip
Layer 0 grad 1.0
Per-layer ×—
State —
Strong gradient
Weakening
Vanished
Skip path
Unseel.com · Vanishing Gradient