Author

Zhao-Ning Zhang

2 papers indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Preprint Oct 2026

PDScope: Breaking the Prefill-Decode Seesaw for Memory-Bound MoE Inference

Local deployment of MoE-based LLMs on CPU-GPU nodes is attractive for cost and privacy reasons, yet limited GPU memory forces most experts into CPU memory. Prefill is then compute-bound and benefits from aggressive GPU loading, while decode is I/O-bound and requires conservative PCIe transfers. These demands cannot be...

En-Da Yu, De-Zun Dong, Zhao-Ning Zhang et al. · 0 citations

#natural language process... Preprint Oct 2026

Compression Does Not End at Selection: Post-Selection Positional Geometry for Sparse KV Caches

Sparse KV compression reduces long-context inference costs by retaining selected historical states, yet these states typically keep their coordinates from the full history. Under Rotary Position Embedding (RoPE), gaps left by evicted tokens continue to affect query-key matching, potentially limiting the use of retained...

Wan-Yang Hong, Zhao-Ning Zhang · 0 citations