Author

Zai-Yun Peng

View on Semantic Scholar

2 papers indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Preprint Jul 2026

Hager-Zhang Conjugate Gradient Method for Set Optimization with Set-Valued Objective Map of Finite Cardinality

This work introduces a nonlinear Hager-Zhang conjugate gradient method for solving set optimization problems. The objective function under consideration is defined by a finite collection of continuously differentiable functions. Notably, the proposed approach imposes restrictions neither on the existence of a finite generator of the ordering cone nor on any regularity condition at the optimal solution. As a result, the proposed method holds considerable significance for both set optimization and vector optimization problems, with the latter serving as a special case of the former. The study begins by discussing Wolfe line search conditions using Drummond-Svaiter scalarization function. Thereafter, we establish the existence of a step length satisfying the Wolfe line search conditions along a descent direction. The Hager-Zhang scalar conjugate parameter is introduced to derive the search direction for the proposed method. It is established that the direction generated by the proposed method is a descent direction. The well-definedness of the proposed method is given. Furthermore, we discuss some important results and a Zoutendijk-like condition to ensure global convergence. Subsequently, the global convergence of the proposed method is established in an asymptotic manner. Finally, numerical experiments on various test problems validate the practical performance and effectiveness of the proposed technique.

Ravi Raushan, Debdas Ghosh, Zai-Yun Peng · 0 citations

Preprint Aug 2026

A Momentum-Based Variance-Reduced Algorithm for Federated Multiobjective Optimization

Federated learning has traditionally been formulated as a single-objective optimization problem, primarily focused on maximizing model utility. In real-world applications, however, machine learning models often need to optimize multiple and potentially conflicting objectives simultaneously. This motivates federated multiobjective optimization (FMOO), which provides a natural framework for jointly handling multiple task-specific objectives in federated learning. In this paper, we propose a momentum-based variance-reduced algorithm for federated multiobjective optimization. The method incorporates a momentum-driven gradient estimator into the local updates to reduce the variance of stochastic updates, leading to an improved convergence rate. We establish theoretical guarantees showing that the expected Pareto stationarity measure of a randomly selected output iterate decays at a rate of $\mathcal{O}(T^{-2/3})$, improving upon the $\mathcal{O}(T^{-1/2})$ rates established for existing methods such as FSMGDA and FedCMOO. Numerical experiments on federated multiobjective optimization benchmarks demonstrate the effectiveness and competitive performance of the proposed algorithm.

Yong Zhao, Chunlin You, M. N. Dao et al. · 0 citations