Skip to content
Preprint

A Mini-Batch Counterexample to Last-Iterate Convergence in Definable Optimization

Aug 2026 · 0 citations · 6 references
Mathematics

Abstract

We give a counterexample to the convergence conjecture in Remark 12 of [Bolte&Pauwels, 2021] for mini-batch stochastic approximation with definable potentials. The construction uses two convex piecewise-affine, hence semialgebraic, summands on $\mathbb{R}$. We choose a deterministic nonincreasing block stepsize sequence satisfying $\alpha_k = o(1/\log k)$ and an admissible minimum-norm selection from each aggregate batch field. On successive blocks, the iterates form lazy reflected random walks on nested dyadic lattices. An explicit endpoint-cover-time estimate, Markov's inequality, and the first Borel-Cantelli lemma imply that almost surely every sufficiently late block's iterates visit their entire lattice. Consequently, the iterates remain in $[-1,1]$ but do not converge, and their accumulation set is exactly $[-1,1]$, on which the averaged objective is constant. Finally, the construction has $\sum_k \alpha_k^2 =\infty$. Both Chat-GPT 5.6 (Sol) and Gemini Pro 3.1 (DeepThink) were used in the development and drafting of this result.

View source

Similar papers

Preprint Aug 2026

Counterexamples to Whole-Sequence Convergence of Variable-Smoothing Full-Splitting Methods

We study whole-sequence convergence of the smoothing-based full-splitting proximal subgradient method (S-FSPS) for structured nonconvex and nonsmooth fractional programs, introduced by Bo\c{t}, Li, and Tao (SIAM J. Optim., 35(4):2623--2653, 2025) as Algorithm~4.1. Existing theory guarantees only the existence of a subs...

M. Tao · 1 citation · ⚡1
Preprint Jul 2026

Barzilai-Borwein Fails Superlinear Convergence on an Open Set of Quadratics for Every Dimension $n\geq 4$

Barzilai--Borwein (BB) method has shown strong practical performance in continuous optimization, yet its convergence dynamics remains poorly understood. In particular, a central unresolved question is whether BB converges superlinearly for almost every strictly convex quadratic problem and initialization. We provide a...

Dawei Li, Xiaotian Jiang, Mingyi Hong · 0 citations
Jul 2026

The Dimension of Nonterminating Resampling Computations

A randomized algorithm may terminate almost surely even though exceptional random tapes make it run forever. This paper studies the survival tail, the Kolmogorov complexity of one such tape, and the Hausdorff dimension of all of them. For each $s>0$ at which the powered repair matrices commute, the main theorem bounds...

Yunbei Xu · 0 citations
Preprint Jul 2026

Small Counterexamples to the Gaussian Moments Conjecture

We give explicit complex polynomials $P,Q$ in three independent standard real Gaussian variables such that \[ {\mathbb E}(P^m)=0,\qquad {\mathbb E}(QP^m)=m!\neq0 \] for every $m\geq1$. In natural complex linear coordinates, $P$ has five terms and total degree $4$. Hence the Gaussian Moments Conjecture is false in every...

Christopher D. Long · 2 citations · ⚡1
Preprint Aug 2026

Weighted Equitability and Matroid-Constrained Discrepancy

We prove weighted matroid equitability. Let $M=(E,\mathcal{I})$ be a matroid whose ground set can be partitioned into $k$ bases, and assign a nonnegative weight to every element. Then $E$ has a partition into $k$ bases such that the weights of any two bases differ by at most the largest element weight. We present two p...

Kristóf Bérczi, Si-Yue Liu, Victor Reis et al. · 0 citations
Preprint Jul 2026

Sharp Dimension Dependence for the Last Iterate of the SubGradient Method

We study the last iterate of the projected subGradient Method (sGM) for convex Lipschitz objectives defined on $\mathbb{R}^d$. We prove that, for a finite horizon $n$ and a constant stepsize $\eta=\Theta(1/\sqrt n)$, the last iterate achieves an optimization error of order $d/\sqrt n$, showing that the extra $\log n$ f...

Guglielmo Beretta, Tommaso Cesari, Roberto Colomboni et al. · 1 citation · ⚡1

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.