MoEGen: Mixture-of-Experts for Instance-Adaptive LoRA Generation
This work proposes MoEGen, an adaptation framework that shifts MoE-based PEFT from expert selection to expert-conditioned parameter generation, and decouples expert capacity from adapter storage while enabling instance-conditioned adaptation.