Diffusion language models generate multiple token positions in parallel, but few-step decoding makes parallel commitment difficult: tokens that appear reliable individually may be jointly inconsistent, while premature commitments can prevent later context-dependent refinement. In this paper, we introduce SetCommit, a t...
Yuan-Nuo Feng, Yu-Bing Ye, Wen-Shuai Yao et al.· 0 citations
This work investigates diffusion inference using a noise model calibrated and validated against measurements collected from multiple physical CIM chips, and proposes ASSERT, a training-free sampler that uses higher stochasticity early and smoothly transitions to deterministic denoising.
Yuan-Nuo Feng, Yi-Zhe Chen, Wen-Shuai Yao et al.· 0 citations
A hierarchical token protection strategy is proposed that keeps sink tokens and a sliding recent-token window on a higher-precision digital path while processing the bulk KV cache on analog CIM, revealing that initial and recent tokens exhibit disproportionate vulnerability to hardware noise.
Yuan-Nuo Feng, Wen-Yong Zhou, Yuang Ma et al.· arXiv.org· 0 citations
Approximate Speculative Decoding (ASD) is introduced, a training-free verifier that replaces binary first-mismatch truncation with budgeted longest-prefix selection and reuses the contiguous target-greedy suffix without additional approximate decisions or target-model forward passes.
Yuan-Nuo Feng, Zegang Peng, Yu-Xin Xie et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.