We have 3 of 4 papers
We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.
Not the right person? Other researchers publish under this name.
HiF4 is established as the enabling format for end-to-end FP4 RL post-training, and Rollout Residual Quantization (Rollout-ResQ) is established as the activation-side mechanism that makes the gap to BF16 closable.
This work proposes a low-precision training framework based on 2D block FP4 quantization, which enforces transposition-invariant scaling and preserves consistency between forward and backward computations, and combines this with truncation-free scaling and stochastic rounding to control quantization error and maintain unbiased gradients.
This work proposes Residual Fallback Quantization (RFQ), a lightweight activation reconstruction framework that supplements the primary ulta-low-bit activation representation with an auxiliary quantized residual pathway that improves activation fidelity while preserving the efficiency advantages of ultra-low-bit computation.
We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.
