Author

Peng Cheng

h-index 2 View on Semantic Scholar

We have 2 of 7 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#natural language process... Preprint Sep 2026

Expert-Space Exploration in MoE Reinforcement Learning

ESRL is introduced, an architecture-aware framework that explicitly explores the expert-routing space of MoE models, and preserves high-confidence experts as anchors, and restricts stochastic routing to a plausible candidate pool, thereby retaining reliable computation paths.

Hong-Yi He, Zheng-Wen Lin, Xiao Liu et al. · 0 citations

#machine learning Feb 2026

MSign: An Optimizer Preventing Training Instability in Large Language Models via Stable Rank Restoration

This work proposes MSign, a new optimizer that periodically applies matrix sign operations to restore stable rank in a 5M-parameter NanoGPT model, and proves theoretically that these two conditions jointly cause exponential gradient norm growth with network depth.

Lianhai Ren, Yucheng Ding, Xiao Liu et al. · arXiv.org · 1 citation