Understanding LLM Quantization through Activation-Guided Compensation and Orthogonal Residuals
Practical guidelines for applying randomized Hadamard rotation, sign selection, and channel scaling are derived, which explain how random signs suppress constructive interference among persistent outlier channels, how sampling multiple sign patterns can improve transformation selection, and how second-moment balancing...