J. Mourrat

Singular perturbations and hierarchical learning in two-layer neural networks

This paper proves that the constant and linear components of the hidden link function are indeed recovered within the predicted timescales, at sharp explicit thresholds, based on quantitative approximation results for singularly perturbed flows evolving near a manifold defined by integral constraints.