Skip to content

Author

Shiwei Liu

We have 6 of 80 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#machine learning Preprint Oct 2026

DataSense-Bench: The First Step Toward an AI Scientist

As claims about recursive self-improvement (RSI) and artificial general intelligence (AGI) proliferate, we ask a simple question: do frontier AI models have a sense of data, i.e., can they reliably select the right data for training? We introduce DataSense-Bench to study this capability through the fundamental problem...

Yudi Zhang, Ming-Yu Cao, Lu Yin et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Scaling to Tens of Thousands of Test-Time Iterations with Loop-Native Attention Residuals

In this paper, we argue that looped Transformers need their own residual connections to prevent performance degradation as the number of iterations grows. We observe that increasing loop iterations can reduce reasoning accuracy: noisy state updates overwrite correct intermediate deductions and even undo completed solut...

Peng-Xiang Li, Dilxat Muhtar, Di He et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Looping Beyond Twice: A Scalable Recipe for Looped Mixture-of-Experts

Looped Transformers introduce recurrent depth as a new scaling axis for LLMs: by repeatedly applying shared Transformer blocks, they increase effective depth without increasing parameter count. However, the benefits of looping remain unclear for large MoE LLMs under FLOPs-matched comparisons. The main reason is that th...

Di He, Peng-Xiang Li, Da Chang et al. · 0 citations
#machine learning Preprint Sep 2026

UniCache: Task- and Type-Aware KV Cache Compression for Unified Multimodal Models

Unified multimodal models combine understanding, generation, and editing within a single network, offering a promising foundation for versatile multimodal applications. However, growing multimodal contexts make KV cache storage and access increasingly costly. Existing KV cache compression methods are typically tailored...

Wan-Qi Yang, Yue-Xiao Ma, Mei Xie et al. · 0 citations
#machine learning Preprint Sep 2026

FlashLoop: Fast and Memory-Efficient Looped Transformers via Lazy Updates

FlashLoop is introduced, a training-free inference framework that reduces cross-loop redundancy through token-sparse updates, sparse attention, and KV-residual quantization, substantially improving the practicality of scaling Looped Transformers to greater computational depths and longer context.

Wan-Qi Yang, Shi-Wei Liu · 0 citations
Jul 2026

ISO: An RLVR-Native Optimization Stack

Reinforcement learning with verifiable rewards (RLVR) is rapidly advancing the reasoning capabilities of language models, yet the optimization layer that converts reward feedback into weight-space updates remains poorly understood. Building on our prior analysis (Zhu et al., 2025), we study this missing layer through t...

Hanqing Zhu, Wenyan Cong, Zhizhou Sha et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.