Quant

LLM Quantization

8bit-Quantization Implementation for LLama-2-7b Model

February 23, 2025 · 18 min · Zhiyang Shen