Geodesics and Low Rank Behavior in the Deep Linear Network
A general system of ordinary differential equations describing geodesics in the DLN is derived and an investigation into using an entropic log-volume form related to the geometry on the full-rank manifold as an explicit regularizer for a simple class of energies is investigated.
Alan Chen, Govind Menon
· 0 citations