Jul 2026
T^2MLR: Transformer with Temporal Middle-Layer Recurrence
Transformers with Temporal Middle-Layer Recurrence (T2MLR), a transformers-based latent reasoning architecture that fuses a cached middle layer representation from the previous token directly into an earlier layer of the current token position, enabling abstract intermediate computation to persist across decoding steps with little inference overhead.
Ziyang Cai, Xingyu Zhu, Yihe Dong et al.
· arXiv.org · 6 citations
· ⚡1