This paper studies DC composite optimization problems with simultaneous conic and manifold constraints. We propose an inexact proximal linearized exact penalty algorithm based on a distance-based penalty function for the conic constraint. The algorithm successively computes approximate minimizers of proximal linearizations of the penalty function over the tangent spaces of the manifold under a readily verifiable inexactness criterion, with adaptive updates of the proximal and penalty parameters. Under the boundedness assumption on the sequences of iterates and penalty parameters, we establish an $O(\epsilon^{-2})$ worst-case complexity bound for finding an $\epsilon$-stationary point. Moreover, when semi-proximal ADMM is employed to solve the subproblems, the resulting oracle complexity is $O(\epsilon^{-2}\log\epsilon^{-1})$ provided that the distance function and the first DC component are piecewise linear-quadratic, while an accelerated variant achieves an $O(\epsilon^{-4})$ oracle complexity. If, in addition, the associated potential function satisfies the KL property, the whole sequence of iterates converges to a stationary point. Extensive numerical experiments on composite optimization problems with orthogonal manifold, nonnegative cone, and second-order cone (SOC) constraints demonstrate the effectiveness of the proposed method.
This paper considers a nonconvex fractional optimization problem with composite structure and nonlinear equality constraints. We reformulate the problem as a non-fractional min-max problem with corresponding optimal solutions. By linearizing the nonlinear constraint terms in the augmented Lagrangian and incorporating B...
Peng-Jie Liu, Jin-Hua Chen, Minh N. Dao et al.· 0 citations
This work proposes a novel single-loop algorithm based on a constrained reformulation in which lower-level stationarity is imposed as a constraint, and constructs a regularized Lagrangian by introducing a quadratic regularizer and restricting the dual variable to a bounded domain.
We introduce Envelopt, a globally convergent iterative framework for a broad class of structured optimization problems where a smooth objective is augmented by a nonsmooth convex regularizer composed with a smooth mapping, and the variables are subject to general smooth constraints. All smooth functions may be nonconve...
In this paper we propose first-order methods for a class of nonsmooth composite strongly convex--strongly concave and nonconvex--concave minimax optimization. We first develop an inexact proximal method and an accumulative regularizated method for strongly convex--strongly concave problems. The latter achieves the opti...
An abstract KL principle for conditional expected descent with memory and summable tails using only the ordinary pointwise KL property is developed, which yields almost-sure finite length, whole-sequence convergence, and deterministic KL rates.
We develop a Halpern-accelerated majorized alternating direction method of multipliers (ADMM) with possibly indefinite proximal terms for linearly constrained convex composite optimization. Majorization simplifies the subproblems but introduces a forward perturbation to the standard degenerate proximal point representa...
Ning Zhang, Ben-Qi Liu, Li-Wei Zhang· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.