Towards Efficient Reasoning: Learning Causal Shortcuts for Diffusion Language Models
This work introduces a step-by-step token extraction procedure to extract causal shortcuts from data, and applies parallel prioritized masking on these tokens during training to enable efficient and accurate convergence to correct answers via causal shortcuts.
Dian Jin, Kai-Rong Han, Bao-Hong Li et al.
· 0 citations