Skip to content

Author

Itay Lavie

1 paper indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#machine learning Preprint Oct 2026

A Solvable Model of Adaptive Learning Rate Rescaling: Acceleration, Stability&Scaling

A recurring design principle in modern optimizers is to decouple update magnitude from the raw gradient norm, yet its consequences for learning-curve and resource scaling remain unclear. We isolate this mechanism by studying normalized SGD in a random-feature model with power-law teacher and data covariance. Fixed-norm...

Itay Lavie, Clarissa Lauditi, Cengiz Pehlevan · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.