Mikaela Martins

Where Are Language-Specific Features Represented in Multilingual LLMs? Everywhere

Previous work has argued that multilingual LLMs encode language-specific features most strongly in their initial and final layers, implying that intermediate layers support language-agnostic representations. This paper reconsiders this finding by performing four different experiments: three that undertake a fine-graine...