itsublog
Posts/by Series
Posts/by Year
All Posts
Friendly Links
Light
Dark
Auto
All Posts
Posts here include English/Japanese/Chinese posts.
INFOTH Note 20: Channel Coding Schemes
Maximum Likelihood Decoding, Block Coding (Binary Linear, Hamming, etc.) & Polar Codes
2025-11-13
2 min read
Notes
Information Theory and Coding (UCB FA24 EE229A, rewritten in 2025)
INFOTH Note 19: Channel Coding Theorem for DMC 2
Proof of Shannon's Channel Coding Theorem, Converse Theorem
2025-11-06
1 min read
Notes
Information Theory and Coding (UCB FA24 EE229A, rewritten in 2025)
INFOTH Note 18: Channel Coding Theorem for DMC 1
Discrete Memoryless Channel, Shannon's Channel Coding Theorem (2nd)
2025-11-04
1 min read
Notes
Information Theory and Coding (UCB FA24 EE229A, rewritten in 2025)
Note: Gated DeltaNet & Qwen3-Next
Notes for Gated DeltaNet & Qwen3-Next.
2025-10-31
1 min read
Paper Reading
2025 Paper Reading
,
Architectures
Paper Reading: SEER (Structured Reasoning and Explanation via RL)
SEER: Facilitating Structured Reasoning and Explanation via Reinforcement Learning.
2025-10-20
3 min read
Paper Reading
2025 Paper Reading
INFOTH Note 9: Differential Entropy
Differential Entropy (for Real-valued/Continuous R.V.s)
2025-10-02
3 min read
Notes
Information Theory and Coding (UCB FA24 EE229A, rewritten in 2025)
INFOTH Note 8: BW Transform
Burrows-Wheeler Transform
2025-09-30
1 min read
Notes
Information Theory and Coding (UCB FA24 EE229A, rewritten in 2025)
INFOTH Note 7: Huffman & Arithmetic Coding
Huffman Coding and Arithmetic Coding
2025-09-25
3 min read
Notes
Information Theory and Coding (UCB FA24 EE229A, rewritten in 2025)
INFOTH Note 6: Kraft's Inequality, Shannon Code
Codes, Kraft's Inequality, Shannon Code
2025-09-23
3 min read
Notes
Information Theory and Coding (UCB FA24 EE229A, rewritten in 2025)
INFOTH Note 5: Fano Ineq., Entropy Rate, AEP
Fano's Inequality, Markov Chain, Entropy Rate, Asymptotic Equipartition Property and Lossless Compression
2025-09-16
3 min read
Notes
Information Theory and Coding (UCB FA24 EE229A, rewritten in 2025)
««
«
1
2
3
»
»»