Correlation flow governs learning at criticality
Combining mean-field theory and random matrix theory, a direct link between correlation propagation and the Neural Tangent Kernel (NTK) is established that governs learning in the sequential limit of infinitely wide, infinitely deep networks.
andrea Combette, Nelly Pustelnik, Antoine Venaille
· 0 citations