Author

Zi-He Song

h-index 4 View on Semantic Scholar

We have 2 of 12 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Preprint Oct 2026

SPECMEM: Accelerating Agentic Tool Calling via Live Memory Management

Tool-calling agents are mostly optimized for accuracy; in deployment, however, their growing cost is latency: every tool call is decoded autoregressively. Speculative decoding accelerates this without changing the output, and retrieved past calls make strong drafts under real use, where each user's behavior tends to re...

Zi-He Song, Wen-Ting Zhao, Ye Liu et al. · 0 citations

Jul 2026

BlockServe: Block-Grained Continuous Batching for High-Throughput Diffusion LLM Serving

BlockServe is presented, a continuous batching framework that integrates block-grained scheduling -- immediately evicting completed requests at block boundaries -- with mixed-state execution that extends dual cache and parallel decoding to heterogeneous batches via gather-scatter indexing.

Yuanjie Zhu, Liangwei Yang, Ke Xu et al. · arXiv.org · 0 citations