DELA is introduced, a plug-in framework that enables controllable draft refinement with a frozen DLM and provides a modular approach to explicit draft-level control in diffusion language models.
Xin-Song Feng, Che-Nan Wang, Le-Shu Tang et al.· 0 citations
Mixture-of-Experts (MoE) decoding on scratchpad-based tensor accelerators (STA) is dominated by moving expert weights while the compute engines sit idle. This traffic is hard to hide, because the experts are known only after routing, and hard to shrink without losing quality or adding critical-path work. We present CAR...
Bin Ma, Wen-Jie Fan, Jonny Liu et al.· 0 citations
This work presents a principled framework that penalises or compensates anomalous confidence arising from collapsed generation patterns, by comparing a token's observed frequency against its corpus prior through an adjacent-conditional probability construction.
Wenjie Fan, Bin Ma, Dong Li· arXiv.org· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.