Author

Hua-Yu Deng

h-index 1 View on Semantic Scholar

We have 2 of 2 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#artificial intelligence Preprint Sep 2026

ROSS: Relearning from Self-Generated Rollouts through Selective Supervision

Large language model post-training generates self-generated rollouts through reinforcement learning and on-policy distillation, yet this experience is often treated as stale once the policy advances. Historical rollouts can remain compatible with a later policy while preserving behaviors that the policy no longer expre...

Zhi-Wei Zhang, Hua-Yu Deng, Fei Zhao et al. · 0 citations

#artificial intelligence Preprint Sep 2026

Verify Before You Distill: Prompt-Level Teacher Gating for On-Policy Distillation

On-policy distillation (OPD) accelerates post-training by providing dense token-level supervision from a frozen teacher on the student's own rollouts. Vanilla OPD applies this supervision uniformly across prompts, without checking whether the teacher is reliable for each prompt. Because reverse KL is mode-seeking, a co...

Zhi-Wei Zhang, Zechen Sun, Fei Zhao et al. · 1 citation