Preprint
Oct 2026
LIRQuant: An Efficient Locally Isolated Rotation Quantization Method for Large Language Models
Post-Training Quantization (PTQ) enables efficient deployment of Large Language Models (LLMs), yet activation outliers remain a key challenge for low-bit quantization. Existing global transformation methods overlook heterogeneous channel sensitivity to quantization noise, leading to suboptimal accuracy-efficiency trade...
De-Sheng Xu, Hang Li, Tian-Chen Song et al.
· 0 citations