TwinKV, a training-free method that discounts value energy by nonlocal post-RoPE key frequency, is introduced, showing that modest frequency corrections can change retention and answering outcomes, with effects that depend on the model and task.
Hong Chen, Yuan Zeng, Yong-Wei Huang et al.· 0 citations
TwinKV is introduced, a training-free, attention-free redundancy signal that detects whether a token's key has a near-duplicate elsewhere in context, challenging the premise behind dominant eviction methods.
Hong Chen, Yuan Zeng, Yong-Wei Huang et al.· 1 citation
SemTrace is introduced, a source-grounded semantic watermark for detecting whether a generated review was influenced by a known protected manuscript copy, and targets model-agnostic, assigned-copy exposure detection while keeping the watermark semantically tied to the source document.
Jun-Yan Zhang, Yuan Zeng, Yong-Wei Huang et al.· 0 citations
A unified efficiency analysis is presented showing that extending the speculation horizon can reduce rather than improve speedup when the marginal acceptance probability falls below the relative drafting cost, and SparseSpec-L, a training-free self-speculative decoding framework for long-context inference is introduced...
Yue Liu, Yuan Zeng, Min Lyu et al.· arXiv.org· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.