Hi There!👋 Welcome to my page!

I am Zhiyang Shen, an undergraduate student at Tsinghua University, majoring in Software Engineering. I’m interested in machine learning, especially focusing on visualization & XAI. Besides, I’m keen on MLsys since my internship at MSR Asia. Please feel free to contact me if you want to explore the fascinating world of AI together!

CUDA Notes

Just tracing the process of learning CUDA programming

September 16, 2025 · 3 min · Zhiyang Shen

Lecture Notes (Pieces)

Lecture notes (pieces) collected from everywhere.

September 11, 2025 · 7 min · Zhiyang Shen

Research Idea

Record some research ideas of my interest.

August 16, 2025 · 5 min · Zhiyang Shen

What if Each Number is a Polynomial?

关于数论的一些很久以前的小想法 / Some naive ideas about number theory years ago …

June 26, 2025 · 1 min · Zhiyang Shen

Understanding Diffusion Models

From differential equation to diffusion models

March 15, 2025 · 14 min · Zhiyang Shen

LLM Quantization

8bit-Quantization Implementation for LLama-2-7b Model

February 23, 2025 · 18 min · Zhiyang Shen

Random Thoughts & Ideas

碎碎念

February 6, 2025 · 2 min · Zhiyang Shen

Notes on Linear Attention

Notes on topics related to linear attention.

January 18, 2025 · 4 min · Zhiyang Shen

Machine Learning Compilation

Lecture Notes on ML Compilation by Tianqi Chen

January 15, 2025 · 1 min · Zhiyang Shen

Write a Memory Allocator for PyTorch

Write a memory allocator from scratch.

May 16, 2024 · 7 min · Zhiyang Shen