We establish sharp convergence rates for quadratically regularized optimal transport with quadratic cost in the regime of small regularization $\varepsilon$. In particular, we quantify the sparsity of the support of the regularized optimizer. For smooth marginal densities in $\mathbb{R}^d$, this support lies within a distance of order $\varepsilon^{1/(d+2)}$ from the Brenier graph, and every section of the support is sandwiched between balls with radii of that order. The geometry of the support is closely linked to the dual potentials. We show that the potentials satisfy uniform two-sided Hessian bounds and converge uniformly at rate $\varepsilon^{2/(d+2)}$, while their gradients converge at rate $\varepsilon^{1/(d+2)}$. The rates are sharp, and we further identify the regularity threshold where convergence breaks down.
We consider the problem of noisy gradient-free minimization of the k-th order partial derivative of a $\beta$-H{\"o}lder function supported on a d-dimensional cube. We show that T ^{($\beta$+d+k)/(2$\beta$+d)} log(T )^{(\beta-k)/(2\beta+d)} is a non-asymptotic minimax rate of the T step cumulative regret for all $\beta...
Théo Paquier, A. Tsybakov, F. Portier et al.· 0 citations
We establish interior maximal $L^{q_c}$-regularity for bounded strong solutions of $u_t-\Delta u+|Du|^\gamma=f$ in $\mathbb{T}^d\times(0,T)$, where $d\geq 2$, $\gamma>2$, and $q_c=(d+2)(\gamma-1)/\gamma$. The estimates are uniform for uniformly bounded families of solutions whose source terms range over a bounded, unif...
We prove that first-order algorithms require $\Omega(\delta^{-1}\epsilon^{-3})$ gradient queries (in the worst case) to find a $(\delta,\epsilon)$-Goldstein stationary point of a Lipschitz function, at which there is a convex combination of gradients within distance $\delta$ whose norm is at most $\epsilon$. This lower...
The branched transport problem is a nonconvex and nonsmooth variational optimization problem on normal $1$-currents in $\mathbb{R}^n$ with prescribed boundary. The optimality is with respect to some non-decreasing, lower semicontinuous, and subadditive function $\tau:\mathbb{R}_+\to\mathbb{R}_+$ with $\tau(0)=0$ descri...
We study the deterministic oracle complexity of smooth convex optimization when the algorithm receives only exact function values. The objective is a globally $\beta$-smooth convex function, all queries and the final output are restricted to the Euclidean ball of radius $R$, and the unique minimizer lies in the ball of...
Wen-Dao Wu, Hai-Han Zhang, Chen-Heng Zhang et al.· 0 citations
We study the time-uniform convergence of the raw iterate of standard stochastic gradient descent (SGD) for unconstrained smooth convex objectives. We prove that, under standard noise assumptions, the time-uniform convergence rate gets arbitrarily close to $\sqrt{\log n / n}$ but never reaches it. More specifically, we...
Rui-Jie Li, Kang Chen, Tian-Yu Wang· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.