BlockServe: Block-Grained Continuous Batching for High-Throughput Diffusion LLM Serving
BlockServe is presented, a continuous batching framework that integrates block-grained scheduling -- immediately evicting completed requests at block boundaries -- with mixed-state execution that extends dual cache and parallel decoding to heterogeneous batches via gather-scatter indexing.