Information Theory and Coding (UCB FA24 EE229A, rewritten in 2025)

INFOTH Note 2: Joint & Conditional Entropy, Chain Rule

Definition of Many Entropies and the Chain Rule. We have a specific def for joint entropy.

INFOTH Note 1: Axioms & Def of Entropy

Shannon Entropy, Axioms, Entropy and Concavity