A novel method, namely AnDPro, is proposed, which introduces a projection-based scoring function to more accurately measure token importance and guide more accurate token selection in key-Value cache eviction.
Zijie Geng, Jie Wang, Ziqi Liu et al.· Neural Information Processin...· 6 citations
It is found that OPD transfers a teacher's reasoning behavior rather than its answers to particular problems: training difficulty barely matters, and even problems the teacher never solves are useful.
Zhaoyi Li, Deyang Kong, Yuan Wei et al.· 1 citation
The exact selection time for an isolated cycle of NOTEARS and DAGMA is derived, and a truth-free separation statistic predicts selection time on 320 official NOTEARS/DAGMA trajectories.
Rui Wu, Zongyuan Chen, Hong Xie et al.· 0 citations
The resulting lesson is task-specific: a first stage for generated controls should be judged by control fidelity, downstream relevance, and graph compatibility together.
Rui Wu, Zongyuan Chen, Hong Xie et al.· 0 citations
The results show that simple parameter averaging, when paired with lightweight dimensional adaptation and carefully controlled ratios, is a surprisingly strong baseline for heterogeneous LLM merging, suggesting that the limits of direct weighted fusion may also bound what more complex heterogeneous merging methods can...
Jiahe Fan, Yinghao Hou, Sixiang Chen et al.· 0 citations
SWIM (Step-Wise Integrated Measure), a list-level evaluator that models user behaviors as a finite-horizon prefix session-level survival process, and efficiently estimates continuation probabilities and utilities in parallel, satisfying strict industrial latency constraints.
Yuan Pu, Cheng-Hao Zhang, Chao Feng et al.· 0 citations
The O1 Embedder is proposed, a novel approach aiming to endow retrieval models with similar capabilities to address challenges like multi-task retrieval, zero-shot retrieval, and tasks requiring intensive reasoning of complex relationships.
Ruiran Yan, Wen Xiong, Ze Liu et al.· Annual Meeting of the Associ...· 2 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.