Notes

INFOTH Note 5: Fano Ineq., Entropy Rate, AEP

Fano's Inequality, Markov Chain, Entropy Rate, Asymptotic Equipartition Property and Lossless Compression

INFOTH Note 4: Cond. MI & Cond. KL, Data Processing Ineq.

Conditional Mutual Information, Conditional Relative Entropy, Chain Rule for these things, Properties, and Data Processing Inequality

INFOTH Note 3: Relative Ent. (KL), Mutual Info.

Log-sum Ineq., Relative Intropy (aka. KL Divergence) and Mutual Information

INFOTH Note 2: Joint & Conditional Entropy, Chain Rule

Definition of Many Entropies and the Chain Rule. We have a specific def for joint entropy.

INFOTH Note 1: Axioms & Def of Entropy

Shannon Entropy, Axioms, Entropy and Concavity

[2024 Summer GeekPie HPC Lecture Notes] Week 3 Exercise

Heat Conducting Simulation Optimization (TODO)

[MPI] MPI Matrix Multiplication

Implementing Parallel Matrix Multiplication with MPI

[MPI] MPI Scan explained

用人话说 MPI Scan 函数的功能

[2024 Summer GeekPie HPC Lecture Notes] Week 1 Exercise

Singularity building for CS110 HW3

[2024 Summer GeekPie HPC Lecture Notes] Week 2: Running

Notes for week 2 lecture of 2024 Summer GeekPie HPC Lectures. (Chinese)