Chuyan Zhou
Junior Student in CS Major
ShanghaiTech University
I’m currently an undergraduate student at ShanghaiTech University majoring in Computer Science & Technology. I am also an undergraduate researcher in the field of NLP, with a focus on LLMs and related areas. Here is my Curriculum Vitae.
Research Interest
Currently, I am most interested or committed in these research topics:
- Post-training of LLMs
- Reinforcement Finetuning, Process Reward Models & Design
- Distillation
- Diffusion LLMs and its Scaling,
- Latent/Soft Token LLMs
- Efficient LLMs, such as
- Parallel Decoding (Speculative/Jacobi/…)
- Quantization,
- KV Cache Compression/Pruning,
- Combination of Connectionist and Probabilistic/Symbolic Methods for NLP
- Mechanistic Interpretability
- Sparse Autoencoders
- AI for Biology
where the bold items are which I have nonzero experience on. Generally, I am interested in researches in fields involving Natural Language Processing, Machine Learning Systems & Theories, Reinforcement Learning, AI for Biology and Computer Vision.
Misc
- C1 level in Japanese & English (JLPT N1 169/180, TOEFL iBT 108/120)
- I post blogs here for research, notes and random things such as my traveling:
Following is my publication list and research project experience.