Shannon Entropy ·
Bits of Information
un
seel
.com · H = −Σ p·log₂ p · surprise, averaged
symbols
2
entropy
1.00
bits
max log₂n
1.00
distribution
fair coin
probability bar p(x)
self-info −log₂ p
entropy needle H
max entropy log₂n
▶ Play
←
→
🔇 Unmute
Reset
Un
seel
.com · Shannon Entropy