Haihao Shen

Recurrent Residual Quantization: A Progressive Multi-Precision Representation for LLMs

Recurrent Residual Quantization (RRQ) is introduced, a post-training quantization (PTQ) framework that represents weights as a low-bit quantized base together with a sequence of quantized residual corrections, enabling multiple effective precisions from a single checkpoint.