Preprint
Aug 2026
Meta-Learning Where to Allocate Experts: Task-Conditioned Layer-Wise Compression for MoEs
MetaNet is proposed, a support-set controller that predicts, for each layer, an expert-retention threshold and a bounded routing bias and provides a tunable accuracy-expert-activation trade-off on DeepSeek-MoE-16B-Chat.
Rong-Feng Wang, Shitao Weng, Zhiquan Wang et al.
· 0 citations