2026· International Conference on Language Resources and Evaluation· pp. 3861-3874· 0 citations· 90 references
Computer Science
TL;DR
A rigorous, large-scale analysis of gender bias in a diverse set of 20 publicly available Spanish generative LLMs, finding systematic patterns consistent with pervasive cultural stereotypes, echoing findings from earlier masked language models are uncovered.
Understanding gender biases in large language models (LLMs) is increasingly important as these systems become embedded in decision-support tools with real consequences. Prior research has focused only on a small set of models, leaving open the extent to which gender biases are common and heterogeneous across LLMs. We a...
Do large language models (LLMs) exhibit coherent personality profiles, and are these profiles culturally neutral? This study used two validated personality inventories, the Big Five Inventory–2 and the Dark Triad Dirty Dozen, to assess five state-of-the-art LLMs (ChatGPT-4o, Gemini 2.0 Flash, DeepSeek-V3, Ernie 3.5 a...
Yu-Zhan Hang, C. Soto, B. Lignier et al.· Royal Society Open Science· 0 citations
While English language models have been widely examined for anti-queer bias, Dutch models remain understudied. To address this gap, we developed a culturally and linguistically adapted Dutch dataset based on the English WinoQueer benchmark, containing pairs of stereotypical and counter-stereotypical sentences. To valid...
The findings provide the first empirical evidence that seemingly"objective"physical descriptions can retain systematic gender associations in human interpretation, and uncover systematic patterns of model-human misalignment.
Yingjia Wan, Lin L. Lin, Elisa Kreiss· 0 citations
Safety evaluations for large language models rely on surface-form classifiers that report declining harm scores across model generations. We provide evidence that this methodology is systematically incomplete: explicit discriminatory content is transformed rather than removed. We call this \emph{harm laundering}. Analy...
S. Wyer, Sue Black, N. Al Moubayed· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.