Skip to content

Probing cross-lingual differences in how LLMs represent Natural Language Inference

· 0 citations · 45 references

TL;DR

Cross-lingual probe transfer and direct comparison of probe weights show that NLI representations are most alignable in the middle layers: probes transfer best there, and probes trained independently on different languages converge to similar weight vectors, peaking mid-network.

View source

Similar papers

Jul 2026

Similarity All The Way Up: Multilingual Generalization in LLMs Relies on Language-Level Similarity Structures

As Large Language Models (LLMs) grow more capable across diverse tasks, their (in)ability to generalize remains difficult to quantify and poorly understood beyond limited domains. In particular, LLMs are known to struggle generalizing multilingually, to languages outside of English, and that are poorly attested in thei...

Supantho Rakshit, Adele E. Goldberg, Henry Conklin · 0 citations

LLM performance on multi-interlocutor NLI tasks

It is concluded that genuine multi-speaker dialogue inference remains an unsolved problem for current LLMs under standard prompting strategies.

Unknown authors · 0 citations
Preprint Aug 2026

Predicting Multilingual Classification and Translation Performance of LLMs with Cross-Lingual Alignment -- Is English Enough?

A PMI-based translation metric is proposed, which is less dependent on the target language and correlates strongly with chrF, and finds that CLA with English predicts translation quality comparably to or better than source-target CLA.

Adnan Al Ali, Kathy Hämmerl, Jindrich Libovický et al. · 0 citations
Preprint Jul 2026

Inference-Time Steering for Cross-Lingual Factual Consistency in LLMs

It is suggested that cross-lingual inconsistency is at least partly a selection problem, and that simple contextual interventions may outperform more invasive methods for robust, transferable alignment.

Alexander Manev · 0 citations
Preprint Aug 2026

Reversing Arrows in Large Language Models

This work presents the first systematic study of inverse relation directionality in LLMs, using a benchmark consisting of 5,457 instances spanning 27 distinct inverse relation labels and reveals systematic asymmetries in inverse relation classification across LLMs.

Sefika Efeoglu, Adrian Paschke · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.