Author

Xinwen Zhang

Temple University

h-index 3 View on Semantic Scholar

We have 3 of 11 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#machine learning Preprint Oct 2026

Learning What to Distill: Bilevel Top-K Token Selection for Self-Distillation in Large Language Models

Large language models have shown strong reasoning capabilities, but their high inference costs make knowledge distillation an important approach for transferring such capabilities to compact models in resource-constrained scenarios. On-policy self-distillation further reduces the reliance on external large teacher mode...

Heng Liang, Xinwen Zhang, Hong-Chang Gao · 0 citations

#machine learning Preprint Oct 2026

Smoothed Gradient Method for Nonconvex Federated Stochastic Bilevel Optimization

In recent years, federated stochastic bilevel optimization has attracted increasing attention due to its wide range of applications in machine learning. To reduce the computational overhead associated with second-order Hessian and Jacobian matrices, several first-order methods have been proposed. However, existing meth...

Xinwen Zhang, Pei-Ran Yu, Zhao-Song Lu et al. · 0 citations

Convergence Analysis of Decentralized Hessian-/Jacobian-Free Algorithm for Nonconvex Stochastic Bi-Level Optimization

This paper proposes a novel decentralized stochastic first-order optimization algorithm, which does not require second-order Hessian or Jacobian matrices, for the setting where the lower-level loss function is nonconvex but satisfies the Polyak–Łojasiewicz (PL) condition.

Yihan Zhang, Xinwen Zhang, My T. Thai et al. · 0 citations