Preprint
Aug 2026
Activation Outliers Matter: Robust Recovery for Quantized Multimodal LLMs
This work proposes Residual Fallback Quantization (RFQ), a lightweight activation reconstruction framework that supplements the primary ulta-low-bit activation representation with an auxiliary quantized residual pathway that improves activation fidelity while preserving the efficiency advantages of ultra-low-bit computation.
Tanzila Rahman, Mehran Taghian Jazi, Yunke Peng et al.
· 0 citations