We consider the Langevin diffusion $dX_t = - \beta \nabla V(X_t) dt + \sqrt{2} dB_t$ for a general nonnegative real-analytic potential $V$ and a large parameter $\beta$. In the large-$\beta$ limit the process is confined to the zero set of $V$, assuming that it starts there. We derive a candidate limiting evolution on the zero set. To do so, the zero set is partitioned into strata according to a measure of local codimension known as the local learning coefficient and its multiplicity. It is then shown that the Dirichlet form associated with $X$ converges in a certain sense to a hierarchy of Dirichlet forms corresponding to a stochastic evolution on the strata. This evolution is strongly biased toward higher-dimensional, or"more singular", strata. This result is motivated by a question from Watanabe's singular learning theory regarding the learning dynamics of overparameterized statistical models and the generalization puzzle in deep learning. The result suggests a mechanism for the observation that stochastic gradient methods tend to be biased toward singular solutions that generalize well.
We study one-dimensional Jacobi operators of divergence-gradient type on $\ell^2(\mathbb{Z}_{\geq 0})$, with coefficients generated by the doubling map, $a_n(x)=a(2^n x \mathrm{mod} 1)$. For continuous positive sampling functions, we show that the almost-sure essential spectrum is an interval containing the bottom of t...
We prove absolute continuity of the running maximum $X^{\ast}_T=\sup_{0\leq s\leq T}X_s$ of one-dimensional time-inhomogeneous L\'evy--It\^o diffusions driven by a Brownian motion and an independent non-truncated pure-jump L\'evy process. Using Bismut's directional Malliavin calculus on the Wiener--Poisson space togeth...
Given a strongly convex function $u$, equip $R^d$ with a Riemannian metric given by the Hessian $\nabla^2 u$. This is a so-called Hessian manifold. Given a probability density $\mu$ one may run a Langevin diffusion intrinsic to the manifold with stationary distribution $\mu$. Such (Hessian) manifold-valued Langevin dif...
Benjamin Capdeville, Young-Heon Kim, Soumik Pal· 0 citations
We study a penalisation problem for two-dimensional Brownian motion. Starting from the Wiener measure, we consider a family of probability measures obtained by weighting paths by a nonnegative functional $F_t$ depending on $t \geq 0$, $F_t$ being measurable with respect to the $\sigma$-algebra generated by the path up...
Joseph Najnudel, Thammadol Tansrivorarat· 0 citations
We study the one-dimensional stochastic partial differential equation \[ d_t X_t(x)=\frac{1}{2}\Delta X_t(x) +b_1\unicode{x1D7D9}_{\{X_t(x)>0\}} +\sqrt{X_t(x)}\dot W(t,x), \] where $b_1>0$, $\dot W$ is space-time white noise, and the initial condition is a nonnegative, compactly supported continuous function. We prove...
We consider a fractional Brownian motion $B$ with Hurst index $0<H<1/2$, and its maximiser $\tau$ on $[0,1]$. We show that the rescaled process $a^H(B_{\tau+\,\cdot\,/a}-B_\tau)$ converges in $C_{\mathrm{loc}}(\mathbb R)$ to a limiting tangent law that is $H$-self-similar, supported on nonpositive paths pinned at zero,...
C. Mönch· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.
