A mobile MoE runtime that exploits the multi-token verification window of speculative decoding to decouple expert movement from single-token execution, enabling weight reuse, contiguous flash reads, and load-compute overlap.
EchoCache is proposed, an energy-guided cross-modal caching framework for efficient A2V generation that leverages audio time-frequency energy as a saliency anchor to guide latent-level cache updates and further introduces a dynamic timestep-latent caching mechanism with quantized cache management for joint efficiency a...
Jiayu Chen, Xiaoyu Wu, Rongshan Gao et al.· 0 citations
This work proposes Token Radius Attention (TRA), a training-free framework that maps query entropy to an analytic token budget and converts it into a temporally decayed radius without explicit key ranking and achieves 1.05x speedup with competitive generation quality.
Jia-Yu Chen, Zhi-Kun Jiang, Mao-Liang Li et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.