Skip to content

Category

natural language processing

7,775 papers

#natural language process... Preprint Sep 2026

Learning from Teacher Continuations at Student States

We present OLIVE (OnLine InterVEntion). At each iteration, the evolving student policy generates a new prefix, the teacher continues it autoregressively, and the student is updated using cross-entropy computed on the teacher-generated tokens. Each design choice targets a corresponding limitation of existing distillatio...

Hao-Jin Wang, Dylan Zhang, Huai-Bo Chen et al. · 0 citations
#natural language process... Preprint Sep 2026

Cognitive Expert Language Models Better Align with the Corresponding Brain Systems

Large language models (LLMs) can predict human brain activity across a variety of brain regions during natural language comprehension. Typically, however, LLM-brain alignment is measured using one model for different regions of the brain, and then model performance is summarized across regions. This one-model-fits-all...

Zhivar Sourati, Meng-Hong Wu, Nona Ghazizadeh et al. · 0 citations
#natural language process... Preprint Open access Sep 2026

Lost in Translation: Measuring the Effect of Non-Native English on End User Performance of Large Language Models

Large language models (LLMs) are increasingly used by people whose first language is not English, yet these users have been shown to receive systematically lower-quality responses than fluent speakers. Which specific features of non-native English drive this gap remains unclear, because fluency is itself a composite of...

Yusheng Zhou, Eleanor Lin, David Jurgens · 0 citations
#natural language process... Preprint Sep 2026

The Canonical Order Problem: When Large Language Models Are Unreliable Knowledge Bases for Multi-Valued Relations

Large language models (LLMs) are increasingly used as knowledge bases (KBs) due to the vast amount of knowledge they acquire during pre-training. While many works focus on extracting single relational triples, most real-world relations are multi-valued and require generating sets of entities. In this paper, we investig...

Timo Pierre Schrader, Annemarie Friedrich, Simon Razniewski et al. · 0 citations
#natural language process... Preprint Open access Sep 2026

Geometric Representations of African Languages: A Regional Semantic Hub and Cultural Steering

We study how Gemma 4 31B represents African languages and responds to cultural steering. The first study compares nine African languages and three controls using probes, contrast directions, and measures of representation similarity. Transfer from English varies across languages and layers. Directions representing an A...

Muhammad Abdullahi Said, Jonathan Shock · 0 citations
#natural language process... Preprint Open access Sep 2026

Concept Direction Reliability Across Languages with Different Tokenizer Fertility

Extracted sentiment directions can vary across samples even when downstream sentiment classification remains accurate. To evaluate direction reproducibility, we measure split-half agreement in English, Hausa, and Yoruba representations across four language models using both native and translated texts. We identify laye...

Muhammad Abdullahi Said, Abass Oguntade, Elisha Komolafe et al. · 0 citations
#natural language process... Preprint Sep 2026

When Does Correction Become Repair? Mechanistic Auditing of Internal Interventions in Tool-Using LLMs

Before invoking external tools, an agentic LLM must select among a K-way action space: executing a call, seeking clarification, answering directly, or declining. While internal activation steering can alter these pre-execution decisions, conventional aggregate metrics obscure where altered states land and what collater...

Jia-Yi Li, Rui-Zhe Li · 0 citations
#natural language process... Preprint Open access Sep 2026

A Character-Level Neural Approach to Sinhala Sandhi Splitting

Sinhala Sandhi splitting recovers the constituent words or morphemes hidden inside a phonologically merged surface form. The task is important for Sinhala NLP because Sandhi obscures lexical boundaries, but no prior published work has established a neural benchmark for Sinhala Sandhi splitting. We present a character-l...

Yasas Ekanayaka, Deshan Sumanathilaka · 0 citations
#natural language process... Preprint Sep 2026

Question-Specific Knowledge Graphs for Efficient Visual Reasoning

Recent work in visual question answering has shown that vision-language models can exhibit strong reasoning capabilities by translating visual inputs into textual representations. The effectiveness of this translation depends on how well visual details are retained; models need to surface and align both explicit and im...

Ting-Chih Chen, Emile van Krieken, Shu-Jian Yu et al. · 0 citations
#natural language process... Preprint Open access Sep 2026

Beyond the Context Window: An Adaptive Entropy-Based Routing Framework for Hybrid Retrieval and Long-Context Language Models

Modern large language models now support context windows of more than one million tokens, which has raised the question of whether retrieval-augmented generation (RAG) is still necessary. Pure long-context (LC) processing is expensive and is known to under-attend to information placed in the middle of long inputs, whil...

Isaac Olufadewa, Miracle Adesina, Ezekiel Oladejo et al. · 0 citations

From tech blogs

See all →
MIT News · Artificial Intelligence Oct 15, 2026

AI model decodes the language cells use to communicate

A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.

Microsoft Research Blog Oct 15, 2026

Proof-based general-purpose computing with Magnetar

Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.

MIT News · Artificial Intelligence Sep 24, 2026

Estimating suicide risk from text

A new language-processing tool could help identify the highest-risk individuals from natural language, enabling swifter interventions.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.