Skip to content

Author

Zhenyu Pan

We have 3 of 26 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Attention Sinks and Outliers in Attention Residuals

OASIS is proposed, an outlier- and sink-aware method that stabilizes dual-normalized attention-residual architectures through explicit null routing and token-to-depth null coupling and offers insight into the low-bit sensitivity observed in AttnResidual.

Haozheng Luo, Hao-Ran Dai, Shao-Ling Zhang et al. · 2 citations
Review Jul 2026

Progress Reward Modeling for Robotic Learning: A Comprehensive Survey

A unified view of progress reward modeling for robotic learning is provided in three connected steps that connect what a progress model is, how it is built, and how its quality is validated.

Jian-Shu Zhang, Ke-Liang Wu, Haoran Lu et al. · 5 citations

LLMZero: Discovering Adaptive Training Strategies for RL Post-Training via LLM Agents

LLMZero, an agentic system that optimizes training trajectories via tree search by diagnosing pathologies at each checkpoint and proposing coordinated multi-parameter transitions, discovers strategies that improve over the base model and over grid search and over grid search, consistently outperforming random search an...

Haoyang Fang, Wei Zhu, Boran Han et al. · 2 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.