Constant-Stepsize Stochastic Approximation: Finite-Time Convergence, Gaussian Approximation, and Tail Bounds
Beyond strong convexity, for general convex SGD, a Gibbs limiting law is identified and a pre-limit Wasserstein approximation error under stability and Stein-equation hypothesis is proved, which are validated numerically.