Author

Hongchang Gao

h-index 3 View on Semantic Scholar

We have 2 of 10 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#machine learning Preprint Oct 2026

Learning What to Distill: Bilevel Top-K Token Selection for Self-Distillation in Large Language Models

Large language models have shown strong reasoning capabilities, but their high inference costs make knowledge distillation an important approach for transferring such capabilities to compact models in resource-constrained scenarios. On-policy self-distillation further reduces the reliance on external large teacher mode...

Heng Liang, Xinwen Zhang, Hong-Chang Gao · 0 citations

Convergence Analysis of Decentralized Hessian-/Jacobian-Free Algorithm for Nonconvex Stochastic Bi-Level Optimization

This paper proposes a novel decentralized stochastic first-order optimization algorithm, which does not require second-order Hessian or Jacobian matrices, for the setting where the lower-level loss function is nonconvex but satisfies the Polyak–Łojasiewicz (PL) condition.

Yihan Zhang, Xinwen Zhang, My T. Thai et al. · 0 citations