Author

Zihe Song

h-index 4 View on Semantic Scholar

We have 1 of 12 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Jul 2026

BlockServe: Block-Grained Continuous Batching for High-Throughput Diffusion LLM Serving

BlockServe is presented, a continuous batching framework that integrates block-grained scheduling -- immediately evicting completed requests at block boundaries -- with mixed-state execution that extends dual cache and parallel decoding to heterogeneous batches via gather-scatter indexing.

Yuanjie Zhu, Liangwei Yang, Ke Xu et al. · arXiv.org · 0 citations