Author

Ruiyang Ma

h-index 3 View on Semantic Scholar

We have 2 of 12 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Preprint Oct 2026

Compositional Performance Modeling of LLM Inference Clusters with Hierarchical KV Caching

Design-space exploration of LLM inference clusters requires predicting how hardware and serving policies interact with hierarchical key-value (KV) caching. Isolated operation profiles alone do not determine cluster latency: reuse changes computational demand, while KV location, capacity, and contention govern execution...

Rui-Yang Ma, Sheng Qi, Dai-Kang Kuang et al. · 0 citations

Preprint Aug 2026

HiSparse: Scaling Sparse-Attention Decoding with Hierarchical KV Cache Management

HiSparse is merged into upstream SGLang and evaluated across three sparse-attention families (DSA, NSA, and Quest) on H200, B200, and GH200 platforms: it improves peak generation throughput by up to 4.7x on long-context workloads while preserving comparable per-token latency and reducing time-to-first-token at high loa...

Zhiqiang Xie, Zhangheng Huang, Ting-Jun Huang et al. · 4 citations · ⚡1