Skip to content

Category

natural language processing

7,546 papers

#natural language process... Preprint Open access Sep 2026

Retrieval Sensitivity to Identity Signals in Queries

Dense retrievers decide which documents reach users and the language models that use them, yet they are typically evaluated with neutral queries. We ask whether the identity signals that real users express in their queries---political ideology and dialect---bias what a retriever returns. We design evaluations in two do...

Andrew Tang, Nicholas Deas, Kathleen McKeown et al. · 0 citations
#natural language process... Preprint Sep 2026

Memory Consolidation Flattens the Temporal Shape of User Facts

Long-term memory systems turn conversations into short stored notes. A note can keep a user fact while losing evidence about whether the fact still holds. For example,"I am driving a Peugeot"can become"The user drives a Peugeot,"which drops the cue that the activity is ongoing. We call this aspectual flattening and mea...

Sugam Panthi, Muhaiminul Yeamin, S. Luo et al. · 1 citation
#natural language process... Preprint Sep 2026

MemFold: Learning Compact Soft Memory for Long-Context Personalization via On-Policy Optimization

An assistant that serves the same user over a long horizon has to answer from what that user has revealed: which preferences still hold, which were revised, and which constraints apply now. Retaining that information is not the same as acting on it, and the two are usually optimized as if they were. Keeping the informa...

Jing-Xuan Wu, Yuzhe Yang, Yi-Qiao Huang et al. · 0 citations
#natural language process... Preprint Open access Sep 2026

Eternal Sunshine of the Spotless Mind: Systematically Erasing LLM's Memories

We consider persistent LLMs that accumulate memories of their interactions with a user over time. Such LLMs maintain memories using external storage, which they can query to overcome the limitations of a fixed context window. Such systems have numerous practical applications, as they can draw on all past interactions w...

Olga Ohrimenko · 0 citations
#natural language process... Preprint Sep 2026

DeepRewind: Predicting and Repairing Premature Commitments in Deep Research Agents

Deep-research agents conduct long-horizon investigations through iterative search, evidence evaluation, belief revision, and synthesis. However, they may commit to claims before sufficient evidence is available, causing later reasoning to reinforce an incorrect interpretation. We introduce DeepRewind, an additive contr...

Amirhossein Abaskohi, Amirhossein Dabiriaghdam, Le-Le Wang et al. · 0 citations
#natural language process... Preprint Sep 2026

Learning from Teacher Continuations at Student States

We present OLIVE (OnLine InterVEntion). At each iteration, the evolving student policy generates a new prefix, the teacher continues it autoregressively, and the student is updated using cross-entropy computed on the teacher-generated tokens. Each design choice targets a corresponding limitation of existing distillatio...

Hao-Jin Wang, Dylan Zhang, Huai-Bo Chen et al. · 0 citations
#natural language process... Preprint Sep 2026

Cognitive Expert Language Models Better Align with the Corresponding Brain Systems

Large language models (LLMs) can predict human brain activity across a variety of brain regions during natural language comprehension. Typically, however, LLM-brain alignment is measured using one model for different regions of the brain, and then model performance is summarized across regions. This one-model-fits-all...

Zhivar Sourati, Meng-Hong Wu, Nona Ghazizadeh et al. · 0 citations
#natural language process... Preprint Open access Sep 2026

Lost in Translation: Measuring the Effect of Non-Native English on End User Performance of Large Language Models

Large language models (LLMs) are increasingly used by people whose first language is not English, yet these users have been shown to receive systematically lower-quality responses than fluent speakers. Which specific features of non-native English drive this gap remains unclear, because fluency is itself a composite of...

Yusheng Zhou, Eleanor Lin, David Jurgens · 0 citations
#natural language process... Preprint Sep 2026

The Canonical Order Problem: When Large Language Models Are Unreliable Knowledge Bases for Multi-Valued Relations

Large language models (LLMs) are increasingly used as knowledge bases (KBs) due to the vast amount of knowledge they acquire during pre-training. While many works focus on extracting single relational triples, most real-world relations are multi-valued and require generating sets of entities. In this paper, we investig...

Timo Pierre Schrader, Annemarie Friedrich, Simon Razniewski et al. · 0 citations
#natural language process... Preprint Open access Sep 2026

Geometric Representations of African Languages: A Regional Semantic Hub and Cultural Steering

We study how Gemma 4 31B represents African languages and responds to cultural steering. The first study compares nine African languages and three controls using probes, contrast directions, and measures of representation similarity. Transfer from English varies across languages and layers. Directions representing an A...

Muhammad Abdullahi Said, Jonathan Shock · 0 citations
#natural language process... Preprint Open access Sep 2026

Concept Direction Reliability Across Languages with Different Tokenizer Fertility

Extracted sentiment directions can vary across samples even when downstream sentiment classification remains accurate. To evaluate direction reproducibility, we measure split-half agreement in English, Hausa, and Yoruba representations across four language models using both native and translated texts. We identify laye...

Muhammad Abdullahi Said, Abass Oguntade, Elisha Komolafe et al. · 0 citations
#natural language process... Preprint Sep 2026

When Does Correction Become Repair? Mechanistic Auditing of Internal Interventions in Tool-Using LLMs

Before invoking external tools, an agentic LLM must select among a K-way action space: executing a call, seeking clarification, answering directly, or declining. While internal activation steering can alter these pre-execution decisions, conventional aggregate metrics obscure where altered states land and what collater...

Jia-Yi Li, Rui-Zhe Li · 0 citations

From tech blogs

See all →
MIT News · Artificial Intelligence Oct 15, 2026

AI model decodes the language cells use to communicate

A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.

Microsoft Research Blog Oct 15, 2026

Proof-based general-purpose computing with Magnetar

Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.

MIT News · Artificial Intelligence Sep 24, 2026

Estimating suicide risk from text

A new language-processing tool could help identify the highest-risk individuals from natural language, enabling swifter interventions.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.