Hi There!👋 Welcome to my page!

I am Zhiyang Shen, an undergraduate student at Tsinghua University, majoring in Software Engineering. I’m interested in machine learning, especially focusing on visualization & XAI. Besides, I’m keen on MLsys since my internship at MSR Asia. Please feel free to contact me if you want to explore the fascinating world of AI together!

Understanding Diffusion Models

From differential equation to diffusion models

Lecture Notes (Pieces)

Lecture notes (pieces) collected from everywhere.

LLM Quantization

8bit-Quantization Implementation for LLama-2-7b Model

Random Thoughts & Ideas

碎碎念

Notes on Linear Attention

Notes on topics related to linear attention.

Machine Learning Compilation

Lecture Notes on ML Compilation by Tianqi Chen

Write a Memory Allocator for PyTorch

Write a memory allocator from scratch.

FFT On the Road

Guide to implement FFT in C++ with parallelism

Random Number Generator

Lecture notes on RNG

Alias Method for Sampling from Discrete Distribution

An Introduction to Alias Method