itsublog
Posts/by Series
Posts/by Year
All Posts
Friendly Links
Light
Dark
Auto
All Posts
Posts here include English/Japanese/Chinese posts.
INFOTH Note 7: Huffman & Arithmetic Coding
Huffman Coding and Arithmetic Coding
2025-09-25
3 min read
Notes
Information Theory and Coding (UCB FA24 EE229A, rewritten in 2025)
INFOTH Note 6: Kraft's Inequality, Shannon Code
Codes, Kraft's Inequality, Shannon Code
2025-09-23
3 min read
Notes
Information Theory and Coding (UCB FA24 EE229A, rewritten in 2025)
INFOTH Note 5: Fano Ineq., Entropy Rate, AEP
Fano's Inequality, Markov Chain, Entropy Rate, Asymptotic Equipartition Property and Lossless Compression
2025-09-16
3 min read
Notes
Information Theory and Coding (UCB FA24 EE229A, rewritten in 2025)
INFOTH Note 4: Cond. MI & Cond. KL, Data Processing Ineq.
Conditional Mutual Information, Conditional Relative Entropy, Chain Rule for these things, Properties, and Data Processing Inequality
2025-09-11
1 min read
Notes
Information Theory and Coding (UCB FA24 EE229A, rewritten in 2025)
INFOTH Note 3: Relative Ent. (KL), Mutual Info.
Log-sum Ineq., Relative Intropy (aka. KL Divergence) and Mutual Information
2025-09-04
1 min read
Notes
Information Theory and Coding (UCB FA24 EE229A, rewritten in 2025)
INFOTH Note 2: Joint & Conditional Entropy, Chain Rule
Definition of Many Entropies and the Chain Rule. We have a specific def for joint entropy.
2025-09-02
2 min read
Notes
Information Theory and Coding (UCB FA24 EE229A, rewritten in 2025)
INFOTH Note 1: Axioms & Def of Entropy
Shannon Entropy, Axioms, Entropy and Concavity
2025-08-28
2 min read
Notes
Information Theory and Coding (UCB FA24 EE229A, rewritten in 2025)
Paper Reading: Pushdown Layers
The paper reading note for Pushdown Layers.
2025-03-14
2 min read
Paper Reading
2025 Paper Reading
Facial Keypoint Detection by Regression & Pixelwise Classification
From IMM Face Database (regression) and iBUG dataset (Gaussian heatmap & Pixelwise classification). (CS280 FA22 Project 5 & CS180 Final Project 1/3)
2024-12-04
9 min read
Projects
Computer Vision Notes (UCB FA24 CS180)
Rectified Flow Explained
A simple explanation for the Rectified Flow framework.
2024-11-20
4 min read
Projects
,
Paper Reading
Computer Vision Notes (UCB FA24 CS180)
,
2025 Paper Reading
««
«
1
2
3
4
»
»»