All Posts

Posts here include English/Japanese/Chinese posts.

INFOTH Note 20: Channel Coding Schemes

Maximum Likelihood Decoding, Block Coding (Binary Linear, Hamming, etc.) & Polar Codes

INFOTH Note 19: Channel Coding Theorem for DMC 2

Proof of Shannon's Channel Coding Theorem, Converse Theorem

INFOTH Note 18: Channel Coding Theorem for DMC 1

Discrete Memoryless Channel, Shannon's Channel Coding Theorem (2nd)

Note: Gated DeltaNet & Qwen3-Next

Notes for Gated DeltaNet & Qwen3-Next.
Featured Image

Paper Reading: SEER (Structured Reasoning and Explanation via RL)

SEER: Facilitating Structured Reasoning and Explanation via Reinforcement Learning.
2025-10-20
3 min read
Featured Image

INFOTH Note 9: Differential Entropy

Differential Entropy (for Real-valued/Continuous R.V.s)

INFOTH Note 5: Fano Ineq., Entropy Rate, AEP

Fano's Inequality, Markov Chain, Entropy Rate, Asymptotic Equipartition Property and Lossless Compression