From the Loss Landscape to Diverse Feature Learning in Neural Networks
A curious phenomenon called mode connectivity, the ability to connect neural networks in the loss surface, defies explanation entirely is elucidates, explains and exploits this special structure in the loss landscape.
David Yunis
· 0 citations