Log-Depth Recurrent Language Modeling
This work extends balanced-tree recursive operators from sequence encoding to autoregressive prediction, enabling all prefix representations to be computed with logarithmic depth and linear runtime.
Yi-Qing Wang, Nuri Cingillioglu, C. Pert
· 0 citations