Skip to content

Author

Yuxuan Lou

1 paper indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

OrScale: Orthogonalised Optimization with Layer-Wise Trust-Ratio Scaling

A dynamic per-layer scalar derived by adapting the LARS/LAMB trust-ratio principle to the orthogonalized setting, where the standard denominator candidates---the raw momentum norm or the polar-factor norm---either live in the wrong unit space or carry no update-scale information.

Yuxuan Lou, Yang You · 1 citation

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.