Author

Xiao-Yao Huang

h-index 0 View on Semantic Scholar

We have 2 of 9 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#machine learning Preprint Sep 2026

EStream: Fast and Memory-Efficient MoE Prefill through Expert Virtualization on Mobile NPUs

Mobile vendors and application developers increasingly deploy LLMs on smartphones for diverse prefill-only services. Yet current systems rely mainly on dense models whose regular computation maps efficiently to mobile NPUs, leaving more capable MoEs underused. MoE prefill does not fit mobile NPUs: NPU graphs are fixed...

Jun-Ming Zhang, Zhen-Zhe Zheng, Fan Wu et al. · 0 citations

Jun 2026

TAILOR: Token-Aware Partitioning and Routing for Edge–Cloud Transformer Inference

TAILOR is presented, a token-aware inference framework that jointly optimizes offline partitioning and online routing for autoregressive transformer serving that reduces end-to-end latency and lowers OOM-induced fallback compared with static partitioning baselines, demonstrating robust inference under long-tailed token...

Xiaoyao Huang, Remington R. Liu, Jie Wu · International Workshop on Qu... · 0 citations