Author

Key

h-index 10 View on Semantic Scholar

We have 2 of 15 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#artificial intelligence Preprint Sep 2026

Function Over Form: Distributional Orthogonalization in Mixture-of-Experts with Replica Expert Mechanism

This paper proposes Distributional Orthogonalization Loss (DO-loss), an auxiliary regularization that shifts the focus from static weight diversity to dynamic routing behavior, and introduces the Replica Expert Mechanism (REM), which improves load balancing through a two-tiered strategy.

Jin-Fan He, Yun-Zhuo Liu, Kai Zhang et al. · 0 citations

#natural language process... Jul 2026

Understanding Is Done Early: A Depth Division of Labor in Large Language Models and Its Use for Unbounded-Context Memory

These results show that long-context memory can be organized along the layer axis, not only the token axis, and expose both the benefits of bounded retrieval and its in-window compression tax.

Han-Lin Liu, Xuan Qi, Chunyu Liu et al. · arXiv.org · 0 citations