A strength coefficient that interpolates between uncalibrated and fully equalized attention, together with an efficient implementation that reduces peak calibration memory overhead from 5-7 GiB to under 1 MiB, and a variant that preserves the pooling token's self-attention mass and redistributes only the remaining mass...
Andrianos Michail, Elias Schuhmacher, Juri Opitz et al.· 0 citations
A pipeline that uses large language models to extract grammatical rules, example sentences, and lexicons from grammar books and generate synthetic parallel corpora for fine-tuning-rather than feeding grammar content into prompts at inference time, as in prior work is introduced.
V. Ravikumar, Sina Ahmadi, L. Jäger et al.· arXiv.org· 0 citations
A large-scale empirical study across a diverse set of embedding models and 275+ languages spanning three parallel datasets, exposing persistent gaps in cross-lingual semantic representation that track language prevalence in training resources and subword tokenization.
Andrianos Michail, Stylianos Psychias, Michelle Wastl et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.