Skip to content

Author

Hong-Yang Li

5 papers indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#artificial intelligence Preprint Oct 2026

Divergence-Routed On-Policy Distillation for Language Models

On-policy distillation (OPD) transfers knowledge from a teacher model to a student along student-generated trajectories, typically by minimizing the reverse Kullback-Leibler (RKL) divergence. However, RKL can provide weak corrective signals for teacher-supported tokens to which the student assigns very low probability....

Tian-Tian Peng, Guan-Nan Lv, Hong-Yang Li et al. · 0 citations

What Does Post-Training Change in Multilingual Reasoning?

These stages establish a constructive post-training path from English-pivoted capability to multilingual reasoning that is reliably delivered, and jointly track correctness, language adherence, termination, and delivery efficiency.

Hong-Yang Li, Xiao Li, Caesar Wu et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Beyond Compression: Diagnosing How Post-Training Changes Mathematical Reasoning

Post-training is central to mathematical reasoning in modern large language models (LLMs), but endpoint pass@1 alone underidentifies what has changed. Gains may reflect newly reachable solutions, cheaper sampling of latent solutions, surface robustness, or memorisation. We compare three post-training paths under a comm...

Hong-Yang Li, Yi-Ming Zhu, Xiao Li et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Solving Without Stopping: On-Policy Distillation at Small Scale

On-policy distillation, where a student learns from a stronger teacher's feedback on its own outputs, is a common way to pass reasoning to smaller models. We analyze what it transfers at small scale, distilling Qwen3-8B into Qwen3 4B, 1.7B and 0.6B students, in thinking mode (reason at length, then end the reasoning an...

Hong-Yang Li, Yi-Ming Zhu, Xiao Li et al. · 1 citation

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.