Jul 2026
No Subspace to Track: Non-Identifiability and Optimizer State in Low-Rank Training
Subspace non-identifiability, clarifies why GaLore works, which patches work, and what to check before trusting a low-rank assumption: the reproducible rank k*.
Noel Thomas
· arXiv.org · 0 citations