Real-world communication often requires pragmatic reasoning: interpreting meanings implied through context and cultural convention rather than stated literally. Existing pragmatic evaluation remains largely limited to English and high-resource languages, leaving Indic languages unexplored despite their linguistic and c...
Camellia is introduced, a benchmark for evaluating entity-centric cultural biases in nine Asian languages, spanning six Asian cultures, and it is found that LLMs can struggle with context understanding in some Asian languages, creating performance gaps between cultures in entity extraction.
Tarek Naous, Anagha Savit, Carlos Rafael Catalan et al.· arXiv.org· 2 citations· ⚡1
It is highlighted that effective cultural alignment requires context-conditional modeling rather than uniform debiasing, and a new direction for mitigating entity-centric cultural bias in LLMs is established.
SOLAR is proposed, an auxiliary objective for supervised fine-tuning that aligns soft-token representations across languages, using English as a pivot and strengthens final-layer cross-lingual similarity and substantially reduces language-cluster separability, suggesting that aligning soft-token representations helps p...
Jiayi He, Jungsoo Park, Wei Xu et al.· arXiv.org· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.