Skip to content

Author

Jian Weng

We have 6 of 30 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#natural language process... Preprint Sep 2026

TomasuLLM: Out-of-Order Speculative Execution for LLM Agents

Long-running tools can dominate coding-agent latency: compilers, test suites, and repository commands take seconds to minutes while the agent idles. This observation stall presents the same tension that drove out-of-order processors -- asequential interface hides work that can be predicted and started early, but a spec...

Jiang-Nan Yu, Ce-Yu Xu, Meng-Ming Li et al. · 0 citations
#artificial intelligence Preprint Jun 2026

Exploring a Layer-Wise Design Space for KV Cache Eviction

This work compositions existing eviction methods across Transformer layers and systematically exploring the resulting layer-wise design space establish layer-wise method composition as an exploitable, placement-sensitive design dimension for KV cache compression.

Chao Fei, Kai-Huan Liang, Han-Zhi Hu et al. · 1 citation
Preprint Aug 2026

Algorithm-Architecture Co-Design for Efficient VLA Inference via Speculative Inference and Verification

Comprehensive evaluations on OpenVLA and RDT across LIBERO and ManiSkill benchmarks show that SpecVLA reduces end-to-end latency significantly while preserving task success rate, and achieves real-time robotic manipulation with both high efficiency and reliability.

Chunyu Qi, Zhuoran Song, Jian Weng et al. · 0 citations
Preprint Aug 2026

A Thread-Register Decoupled GPU Execution Model for Efficient Tensor Computation

This work proposes FIBER, a new architecture that extends the GPU SIMT (single instruction, multiple thread) model, and extends the ISA, microarchitecture, and compiler to realize shared-register addressing, conflict-free operand delivery, and fiber-based program mapping.

Zi-Han Liu, Jingwen Leng, Yang-Jie Zhou et al. · 0 citations
Jul 2026

GPU-Tile-Sim: A Tile-Centric GPU Simulation Framework for LLM Hardware-Software Co-Design

This work proposes GPU-Tile-Sim, a tile-centric GPU simulation framework for LLM hardware-software co-design that represents kernel execution as a warp-level tile graph whose nodes capture tile-level operations and whose edges encode data and ordering constraints.

Yitong Ding, Jiawei Huang, Renyang Guan et al. · 2 citations
Jun 2026

MLX: Multi-Layer Execution for Structured LLM Workload Acceleration on Spatial Architectures

Structured sparsity is a promising approach to scaling large-language-model (LLM) inference, but existing forms such as butterfly-structured sparse projections and transformations often map inefficiently to GPUs due to deep stage dependencies and limited bulk parallelism. This paper presents MLX, an algorithm–architect...

Haibin Wu, Wenming Li, Zhihua Fan et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.