This work investigates how fine-tuning alters internal representations in LLMs, including attention patterns and layer-wise activations, and examines whether these changes are linked to task-relevant components identified by EAP that drive task performance.
Ling-Fang Li, Procheta Sen, Shubham Das et al.· 0 citations
Word-in-Context (WiC) remains challenging for language models, despite recent progress on lexical-semantic tasks. We hypothesise that this difficulty arises not only from comparing two contextual uses of a word, but also from the absence of an explicit sense inventory that specifies the relevant level of semantic granu...
Yi Zhou, Kiamehr Rezaee, D. Bollegala et al.· 0 citations
Cross-lingual alignment (CLA) aims to align the representations of large language models (LLMs) across languages, enabling cross-lingual transfer to improve multilingual capabilities. Previous CLA methods often ignore language-specific information encoded in representations and only consider sentence-level alignment, w...
Taisei Yamamoto, Ryoma Kumon, D. Bollegala et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.