Info Theory and Coding

INFOTH Note 2: Joint & Conditional Entropy, Chain Rule

Definition of Many Entropies and the Chain Rule. We have a specific def for joint entropy.

INFOTH Note 1: Axioms & Def of Entropy

Shannon Entropy, Axioms, Entropy and Concavity