Skip to content

Author

Gagan Agrawal

We have 4 of 12 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Book Open access Oct 2026

BitLLM: Efficient Low-Bit, Conversion-Hiding LLM Decoding on Mobile GPUs

The rapid scaling of large language models (LLMs) has unlocked remarkable capabilities across various domains. However, deploying LLMs on mobile devices remains challenging because of their high computational and memory requirements. Low-bit quantization (e.g., 4-bit weights, 8-bit activations) can reduce model size wh...

Hang-Yu Zheng, Zhi-Hao Shu, Kun-Xiong Zhu et al. · 1 citation
#machine learning Preprint Sep 2026

EAServe: Encode-Aware Disaggregated Serving for Multimodal Large Language Models

EAServe repositions Encode as the control point of the EPD pipeline, exposing three tightly coupled dimensions: when work enters downstream, where prefill executes, and how the GPU is shared, and reaches near-optimal configurations faster than baseline search methods.

Kun-Xiong Zhu, Zhi-Hao Shu, Hang-Yu Zheng et al. · 0 citations
#machine learning Preprint Sep 2026

Mask-Aware Execution for Efficient JEPA Training

M-JEPA is presented, a mask-aware execution architecture that restructures JEPA training without changing the learning objective, and shows that execution restructuring, rather than changes to the JEPA objective, is a key lever for efficient JEPA training.

Md Musfiqur Rahman Sanim, Zhi-Hao Shu, Bahram Afsharmanesh et al. · 0 citations

TierKV: Long-Context On-Device LLMs via Predictive Multi-Tier KV Caching

TierKV is presented, a mobile LLM inference framework built on Predictive Multi-Tier Cache Optimization (PMCO), which improves prefill throughput by up to 17.6x over existing mobile LLM frameworks, reduces RAM-resident KV cache by 12.5-34%, thereby enabling substantially longer contexts under the same memory budget, wh...

Zhi-Hao Shu, Md Musfiqur Rahman Sanim, Jie Hu et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.