Jul 2026
HiFloat4 Format for End-To-End Reinforcement Learning Post-Training of Large Language Models
HiF4 is established as the enabling format for end-to-end FP4 RL post-training, and Rollout Residual Quantization (Rollout-ResQ) is established as the activation-side mechanism that makes the gap to BF16 closable.
H. Mak, Shadan Golestan, H. Le et al.
· arXiv.org · 0 citations