#artificial intelligence
Apr 2026
Unveiling Language Routing Isolation in Multilingual MoE Models for Interpretable Subnetwork Adaptation
A systematic analysis of expert routing patterns in MoE models reveals Language Routing Isolation, in which high- and low-resource languages tend to activate largely disjoint expert sets, and proposes RISE, a framework that exploits routing isolation to identify and adapt language-specific expert subnetworks.
Kening Zheng, Wei-Chieh Huang, Jiahao Huo et al.
· arXiv.org · 4 citations
· ⚡2