LED: Improving Masked Diffusion Language Models by Lookahead Editing
This design introduces a rewritable proposal that uses additional compute to improve expressivity while keeping the simple mask-based transition schedule of MDMs, and fine-tune Qwen2.5-7B and Qwen3-8B to obtain LED-\texttt{7B} and LED-\texttt{8B}, respectively.
Yu-Yan Zhou, Ze-Yuan Yang, Yuxuan Song et al.
· 0 citations