UniPrefill is proposed, a prefill acceleration framework applicable to virtually any model architecture, which directly accelerates the model's computation at the token level and achieves up to 2.1x speedup in Time-To-First-Token (TTFT), with the acceleration becoming increasingly pronounced as the number of concurrent...
MIEdit introduces a predictor-corrector multi-history-step scheme to achieve superior editing quality with fewer steps, and mitigate heterogeneity and conflict between the multi-conditioned noise residuals and gradient terms during sampling, improving stability and editing plasticity under large edits.
Hai-Yan Wei, Yun-Long Wang, Huai-Bo Huang et al.· 0 citations
This paper introduces a mean correction term that effectively suppresses the approximation error, keeping performance degradation manageable even at extreme sparsity levels, and redesigns the sparse attention operator with PackGQA memory access, warp specialization, and pingpong pipelining.
Qihang Fan, Huai-Bo Huang, Zhiying Wu et al.· 2 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.