APEX: Adaptive Expert Prefetching for Memory-Efficient Edge MoE Inference
The results establish adaptive, confidence-driven expert prefetching as an effective approach for efficient MoE inference on edge systems.
We have 2 of 17 papers
We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.
Not the right person? Other researchers publish under this name.
The results establish adaptive, confidence-driven expert prefetching as an effective approach for efficient MoE inference on edge systems.
HYDRA jointly explores chiplet composition, placement, inter-chiplet bandwidth provisioning, dynamic batching, dynamic batching, and runtime scheduling, and a fast Markov-based performance estimator that captures multi-tenant runtime dynamics for efficient and accurate exploration.
We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.