Skip to content

Author

Defu Lian

We have 19 of 382 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

2025

Accurate KV Cache Eviction via Anchor Direction Projection for Efficient LLM Inference

A novel method, namely AnDPro, is proposed, which introduces a projection-based scoring function to more accurately measure token importance and guide more accurate token selection in key-Value cache eviction.

Zijie Geng, Jie Wang, Ziqi Liu et al. · 6 citations
Preprint Jul 2026

Rethinking Heterogeneous LLM Merging: A Weighted Model Averaging Perspective

The results show that simple parameter averaging, when paired with lightweight dimensional adaptation and carefully controlled ratios, is a surprisingly strong baseline for heterogeneous LLM merging, suggesting that the limits of direct weighted fusion may also bound what more complex heterogeneous merging methods can...

Jiahe Fan, Yinghao Hou, Sixiang Chen et al. · 0 citations
Preprint Aug 2026

SWIM: Step-Wise Integrated Measure for Session-supervised List Evaluation in Generative Re-ranking

SWIM (Step-Wise Integrated Measure), a list-level evaluator that models user behaviors as a finite-horizon prefix session-level survival process, and efficiently estimates continuation probabilities and utilities in parallel, satisfying strict industrial latency constraints.

Yuan Pu, Cheng-Hao Zhang, Chao Feng et al. · 0 citations
Conference Open access 2026

Let Retrievers Think Before Action: Thought-Augmented Embedding for Dense Retrieval

The O1 Embedder is proposed, a novel approach aiming to endow retrieval models with similar capabilities to address challenges like multi-task retrieval, zero-shot retrieval, and tasks requiring intensive reasoning of complex relationships.

Ruiran Yan, Wen Xiong, Ze Liu et al. · 2 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.