In this paper, we argue that looped Transformers need their own residual connections to prevent performance degradation as the number of iterations grows. We observe that increasing loop iterations can reduce reasoning accuracy: noisy state updates overwrite correct intermediate deductions and even undo completed solut...
Peng-Xiang Li, Dilxat Muhtar, Di He et al.· 0 citations
Looped Transformers introduce recurrent depth as a new scaling axis for LLMs: by repeatedly applying shared Transformer blocks, they increase effective depth without increasing parameter count. However, the benefits of looping remain unclear for large MoE LLMs under FLOPs-matched comparisons. The main reason is that th...
Di He, Peng-Xiang Li, Da Chang et al.· 0 citations
Comprehensive evaluations on multiple real-world benchmarks suggest that SynthRGB-T delivers superior performance and enhanced visual diversity over existing approaches, and introduces a Visual Grounding Pipeline to enhance semantic alignment.
Jiang-wu Ding, Yiquan Du, Pengxiang Li et al.· 1 citation
Qwen-UI-Agent is presented, a real-world centric foundation GUI agent spanning mobile, computer-use, web, and DeepSearch environments, that sets state-of-the-art performance on mobile-use benchmarks while delivering competitive performance on computer- and browser-use tasks against frontier models.