Meta-Learning Where to Allocate Experts: Task-Conditioned Layer-Wise Compression for MoEs
MetaNet is proposed, a support-set controller that predicts, for each layer, an expert-retention threshold and a bounded routing bias and provides a tunable accuracy-expert-activation trade-off on DeepSeek-MoE-16B-Chat.