Xin-Yue Luo

Prediction Dynamics in Depth-Recurrent Language Models

A sharp margin characterization is derived that decomposes the conservatism of a magnitude bound into common translation, direction relative to the winner, and the pairing of each competitor's update with its score gap to explain finite-depth answer preservation through the geometry and composition of observed score ch...