Skip to content

Author

Zi-Qi Liu

We have 2 of 15 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

2026

Efficient LLM Reasoning via Logit-Based Introspection

Recent Reasoning Large Language Models have demonstrated impressive long-form reasoning capabilities, achieving expert-level performance on complex tasks such as competition-level mathematics and scientific question answering. However, they often suffer from the overthinking problem, leading to excessive token usage, h...

Kai-Hao Zhang, Bin Shi, Kai Sun et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Hyperparameter Scaling Laws Across MoE Sparsity

This work shows that conventional hyperparameter scaling laws are insufficient for ultra-sparse MoEs: the optimal learning rate and batch size vary with activation ratio, and these shifts cannot be explained by either total or activated parameter count alone.

Chang-Xin Tian, Kun-Long Chen, Jia Liu et al. · 1 citation

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.