Skip to content

Author

Zhong-Kai Yu

We have 7 of 14 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Preprint Oct 2026

Understanding GPU Megakernels: Why Residency Can Mislead

Megakernels let one persistent GPU program prepare dependent operators early and execute ready tasks together. We study the benefits and costs of these capabilities by reconstructing two LLM megakernels, ThunderKittens (TK) and VDCores, as separate kernels on H100 using their original operator code. Our results show th...

Xin-Wei Qiang, Zi-Yi Xu, Chang Chen et al. · 0 citations
Preprint Nov 2026

Qubrio: High-Performance Quantum Compilation via Multi-Agent LLM Collaboration

Large Language Models (LLMs) offer an adaptable alternative to traditional quantum compilation heuristics, which bottleneck progress by demanding costly manual redesigns whenever hardware evolves. However, naive single-pass LLM approaches fail under the unique challenges introduced by quantum compilation. We introduce...

Ji-Xuan Ruan, Zhuo Cui, Zheng-Ding Hu et al. · 0 citations
Preprint Nov 2026

LeanSparse: Memory-Efficient Serving for Native Sparse-Attention LLMs

Sparse attention limits the history read by each query, but serving long contexts still requires substantial GPU memory. Existing KV offloading systems retain the full history of indexer keys on GPU, limiting decode concurrency. Prefill's temporary memory demand can further delay admission even when enough memory remai...

Zai-Feng Pan, Chris Wu, Xin-Wei Qiang et al. · 0 citations
Preprint Oct 2026

Zepp: Accelerating Distributed MoE Serving under Relaxed Balance Constraints

Zepp is presented, which directly optimizes the bottleneck communication in distributed MoE serving subject to simplified balance constraints on physical resources, i.e., GPUs and NICs and progressively optimizes inter-node communication across placement, routing, and execution.

Chang Chen, Andrew Yang, Tian-Cheng Chen et al. · 0 citations
Sep 2026

RR-Evict: Fine-Grained Prefix Cache Eviction beyond LRU for Agentic LLM Serving

This work presents RR-EVICT, a fine-grained prefix-cache eviction strategy that distributes reclamation across idle agent trajectories, and implements RR-EVICT in SGLang and evaluates conversational and coding-agent workloads under colocated and prefill-decode-disaggregated serving.

Zai-Feng Pan, Chris Wu, Zheng-Ding Hu et al. · 2 citations
Preprint Aug 2026

PLoRA: An NDP-Enhanced Pooled-Memory System for Cost-Efficient Multi-LoRA Serving

Multi-LoRA serving is how one base model becomes thousands of specialized variants, one adapter per user, task, or agent, and the deployments can hold 1000-plus adapters. Serving them is hard because the workload inverts what GPUs provide: terabytes of memory against only tens of TFLOPS, and because every published sys...

Zhong-Kai Yu, O. Venkatachalam, Zheng Wang et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.