Skip to content

Author

Cheng Liang

2 papers indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Preprint Oct 2026

Asymmetric Looped Transformers: Fixed Global Representations for an Iterative Decoder

Looped Transformers increase effective depth by repeatedly applying shared layers, offering a way to scale computation without increasing parameter count. However, full-stack looping places context construction and iterative state refinement within the same recurrent computation, without explicitly distinguishing their...

Cheng Liang, Teng-Fei Zhang, Wenjie Du et al. · 2 citations
#machine learning Preprint Oct 2026

UpLoop: Training Looped Transformers via Upcycling at No Extra Pretraining Compute

UpLoop is a pretraining schedule that uses upcycling to train looped Transformers while exactly matching a standard dense baseline in final parameter count, total training tokens, and training FLOPs, showing improvements in language modeling and downstream performance.

Cheng Liang, Teng-Fei Zhang, Ya Zhang et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.