Skip to content

Author

Xiaojun Zhai

We have 2 of 25 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Conference Aug 2026

SGLite: A Compact Serving Framework for Large Language Model Inference

Large language model (LLM) serving requires coordinated request admission, scheduling, KV-cache management, attention computation, CUDA Graph capture and replay, and distributed model execution. Established serving frameworks such as SGLang and vLLM deliver high throughput, but their large codebases make individual ser...

Shi-Hao Deng, Xu-Qi Zhu, Klaus Mcdonald-Maire et al. · 0 citations
Open access Jul 2026

Optimal and Energy Efficient Imprecise Computation Task Deployment on Heterogeneous Multicore Platforms Combining DVFS and DPM

A novel QoS-aware task deployment methodology to enhance the Quality of Service (QoS) under resource limitations is introduced and results demonstrate that the proposed method achieves superior system performance compared to existing approaches.

Haotong Zhu, Lei Mo, T. Al-Hasan et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.