Author

Gang Niu

3 papers indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#artificial intelligence Preprint Sep 2026

Estimating and Orthogonalizing Unknown Pre-training Gradients for Continual Fine-tuning of Large Language Models

Continual fine-tuning is essential for large language models (LLMs) to dynamically adapt to real-world environments, yet it inevitably suffers from catastrophic forgetting, particularly the performance degradation of previous tasks and LLMs'general-purpose knowledge. Although existing methods, such as orthogonal gradie...

Bing Wang, C. Li, Xin-Qiang Cai et al. · 0 citations

#artificial intelligence Preprint Sep 2026

ARM: Attention with Routed-Memory for Learnable Sparse Control

Despite advances in long-context inference, large language models (LLMs) remain fundamentally limited by the key-value (KV) caching mechanisms that are necessary for stable computation. Techniques such as selective token eviction and pruning have vastly mitigated these issues, but often discard core information to mana...

Qiu-Hao Zeng, Jerry M. Huang, Peng Lu et al. · 0 citations

#natural language process... Preprint Sep 2026

DenMark: Robust Semantic Watermarking for Diffusion Language Models

DenMark is proposed, a semantic watermarking framework that injects key-dependent signals directly into the DLM denoising process and achieves the best results across all reported detection metrics in all 48 backbone-dataset-attack combinations.

Tian-Hao Ma, Weihao Xuan, Dong-Dong Wu et al. · 1 citation