Btissame El Mahtout

Fast Training of Mixture-of-Experts for Time Series Forecasting via Expert Loss Integration

We propose a novel Mixture-of-Experts framework, referred to as Expert Loss Integration MoE (EliMoE), for time series forecasting. EliMoE addresses the optimization problem arising from small gating weights by incorporating expert-specific losses, which provide each expert with a direct learning signal independent of t...