A global universal approximation theorem in the topology of L^p(\mu) is shown, where any function $f:\mathfrak X\to \mathbb R$ in $L^p(\mu)$ can be approximated to any degree of accuracy by suitable infinite dimensional architectures.
Abstract
Leveraging the neural architectures which we introduced in arXiv:2109.13512v4, we show a global universal approximation theorem in the topology of $L^p(\mu)$, where $1\le p<\infty$ and $\mu$ is a Radon probability measure on a suitable infinite dimensional topological space $\mathfrak X$. Namely, any function $f:\mathfrak X\to \mathbb R$ in $L^p(\mu)$ can be approximated to any degree of accuracy by suitable infinite dimensional architectures. These architectures can be in turn approximated by almost classical neural networks which are specified by a finite number of parameters only. The vectorial case (where $f=f(x)\in E$ and $E$ is a Banach space) is also considered and analogous results are obtained.
We investigate the best $L_2$ approximation of mixed Sobolev spaces by shallow neural networks with $n$ neurons and general activation functions. We first establish an activation-independent Fourier-block principle: if an activation has univariate approximation order $\rho$ in the sense of the Fourier-block property, t...
We construct shallow neural networks with fixed Gaussian and tanh-difference activations on bounded Lipschitz domains $\Omega\subset\mathbb{R}^d$, $d\ge2$. For each $s>0$, explicit deterministic rules prescribe all hidden parameters independently of the target $u\in H^s(\Omega)$. At frequency resolution $M$, the $N_M\a...
We study the problem of constructing highly nonlinear vectorial maps $F: \mathbb F_2^n \to \mathbb F_2^m$. Concretely, we want an $F$ and an $A = A(m,n)>0$ as small as possible, so that for every affine map $L: \mathbb F_2^n \to \mathbb F_2^m$ (of the form $L(x) = M x + b $) we have: $$\mathrm{agree}(F, L) := |\{ x \in...
Swastik Kopparty, Rishabh Kothary, Shanthanu S. Rai· 0 citations
We obtain multivariate martingale central limit theorems in $p$-Wasserstein distance with respect to the $\ell_r$ norm in $\mathbb{R}^d$ for $p\geq 1$ and $r\in [1,\infty]$, which generalize the results for $p=1$ and $r=2$ in the literature. As corollaries, we obtain the Yurinskii coupling and Cram\'er-type moderate de...
Let $\mu$ be an $n$-AD-regular measure in $\mathbb{R}^d$. Chousionis, Garnett, Le and Tolsa [CGLT] proved that $\mu$ is uniformly $n$-rectifiable if and only if the square function built from the density differences $\Delta_\mu(x,r)=\mu(B(x,r))/r^n-\mu(B(x,2r))/(2r)^n$ satisfies a Carleson condition. In this paper we s...
Let $L_v=-\Delta-2v\cdot\nabla$ on $L^2(\mathbb R^n,e^{2v\cdot x}\,dx)$, where $v\in\mathbb R^n\setminus\{0\}$ is a constant drift vector. We prove that the full vector Riesz transform $\nabla L_v^{-1/2}$ satisfies a weak-type $(1,1)$ estimate for real-valued functions with constant at most $2$, uniformly in both the d...
Suman Mukherjee· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.