Why Does Post-Training Quantization Work?
Comparing full-precision and quantized forward passes, and identifying two mechanisms that characterize pretrained quantization robustness, these mechanisms explain why quantization error that passes through numerous layers can still produce only small output changes, and are verified across models and quantization set...
Yu-Xiang Chen, Michael Beyer, Jun Zhu et al.
· 1 citation