Skip to content

Author

Zhouhan Lin

We have 5 of 23 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Preprint Oct 2026

Mixture-of-Memories: Low-Overhead Language Modeling with Modular Knowledge Injection

Large language models store substantial factual knowledge in their parameters, yet this knowledge is difficult to control, update, and reliably elicit at inference time. Existing memory-augmented approaches typically rely on a single auxiliary mechanism, such as retrieval, parameter updates, or neural memory, and there...

Yifan Lu, Ru-Bin Wei, Zi-Yun Zou et al. · 0 citations
#machine learning Preprint Oct 2026

AF-Muon: An AdamW-Free Muon Optimizer for Tied-Embedding Models

Muon improves large-scale training by applying a spectral-norm steepest-descent update to matrix parameters, but practical models also contain parameter blocks that do not fit dense-matrix geometry. One important case is the tied vocabulary table, which appears in language models and other token generators and can rece...

Arash Lagzian, Paniz Halvachi, Jun-Ming Zhang et al. · 0 citations

NCP-ArchPreview Technical Report: Moving towards Latent Space Language Models through Next Concept Prediction

NCP-ArchPreview is introduced, a latent-space language model that pushes autoregressive pretraining beyond standard next-token prediction (NTP) and learns through Next Concept Prediction (NCP) to predict discrete concepts that span multiple tokens, introducing an explicit and more challenging concept-level objective wh...

T.-A. Cao, Chi-Yu Chen, Shuang Cheng et al. · 0 citations
Review Aug 2026

Intern-S2-Preview: Scientific Agentic Foundation Model

Evaluations across scientific, multimodal, agentic, and general-purpose benchmarks show that Intern-S2-Preview-397B achieves competitive or leading results in multiple settings.

Lei Bai, Jiaqi Cao, Chiyu Chen et al. · 3 citations
Jul 2026

Memory Decoder at Scale: A Pretrained, Parametric Long-Term Memory

This work presents Memory Decoder at Scale, scaling memory models up to 6.9B parameters and pretraining them on 300B tokens, demonstrating that independently scaling pretrained memory offers a more parameter efficient path to improving language model performance.

Ru-Bin Wei, Jiaqi Cao, Jiarui Wang et al. · 1 citation

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.