Skip to content

Category

natural language processing

6,756 papers

#natural language process... Preprint Sep 2026

ATTUNER: Recomputation-Free KV Cache Reuse via Query-Side Adaptation

Large language model (LLM) agents repeatedly load reusable content, such as skills, documents, and memory entries, into the current context. Re-encoding this content for every request wastes computation. Position-independent caching (PIC) alleviates this by encoding each artifact independently and reusing its key-value...

Xing-Hao Chen, Jun-Nan Dong, Cai Ke et al. · 0 citations
#natural language process... Preprint Open access Sep 2026

LAURA: Knowledge Distillation for Interpretable Ambiguous Clause Identification in Legal Contracts

Legal contracts contain ambiguities that expose enterprises to financial and legal risks. Some ambiguities allow flexible interpretation without triggering disputes, while others lead to significant legal conflicts. This makes identification alone insufficient, and interpretable rationale analysis essential. We propose...

Amrita Singh, Aditya Joshi, Jiaojiao Jiang et al. · 0 citations
#natural language process... Preprint Sep 2026

ProgressCompass: Embodied Progress Reward Models Are Lost Without the Right Context

Embodied agents now take on ever longer tasks. For long tasks, knowing only whether a task finally succeeds or fails says little; the steps along the way matter. Progress Reward Models (PRMs) score how far a task has come at every step, and serve as dense rewards, verifiers and monitors. Yet in long tasks the current f...

Jian-Shu Zhang, Ke-Liang Wu, Cheng-Xuan Qian et al. · 0 citations
#natural language process... Preprint Sep 2026

G\"odel Forest: Balancing Search Depth and Breadth for Data-Centric Recursive Self-Improvement

Recursive self-improvement (RSI) aims to achieve compounding gains by having models improve themselves. While most existing RSI systems optimize external agent harnesses or prompts around a frozen base model, data-centric RSI directly updates the model's own parameters by training on agent-generated data. However, beca...

Zi-Qi Zhao, Fan-Qing Meng, Hao-Cheng Lu et al. · 0 citations
#natural language process... Preprint Open access Sep 2026

Generating Edit-Inducing Questions for AI Research Manuscripts

We study the ability of LLMs to generate edit-inducing questions whose answer will improve a paper draft. On a dataset of paired submission and camera-ready papers from ICLR and NeurIPS, we compare the helpfulness of questions from GPT models with or without full paper context to that of human reviewers. GPT produces m...

Sebastian Joseph, Zichao Wang, Jennifer Healey et al. · 0 citations
#natural language process... Preprint Open access Sep 2026

Grounded Revision vs. Prior Injection: Probing Retrieval-Augmented Patent Claim Amendment

Retrieval-augmented generation is widely used in professional writing, yet whether retrieval grounds revision or merely injects templates is rarely tested where "correct" has a definable meaning. Patent claim amendment supplies that signal: the examiner names the attacked limitation and cites prior art, providing per-c...

Josepha Michiko Leo, Hyun-seok Min, Yehoon Jang et al. · 0 citations
#natural language process... Preprint Open access Sep 2026

Retrieval Sensitivity to Identity Signals in Queries

Dense retrievers decide which documents reach users and the language models that use them, yet they are typically evaluated with neutral queries. We ask whether the identity signals that real users express in their queries---political ideology and dialect---bias what a retriever returns. We design evaluations in two do...

Andrew Tang, Nicholas Deas, Kathleen McKeown et al. · 0 citations
#natural language process... Preprint Sep 2026

Memory Consolidation Flattens the Temporal Shape of User Facts

Long-term memory systems turn conversations into short stored notes. A note can keep a user fact while losing evidence about whether the fact still holds. For example,"I am driving a Peugeot"can become"The user drives a Peugeot,"which drops the cue that the activity is ongoing. We call this aspectual flattening and mea...

Sugam Panthi, Muhaiminul Yeamin, S. Luo et al. · 1 citation
#natural language process... Preprint Sep 2026

MemFold: Learning Compact Soft Memory for Long-Context Personalization via On-Policy Optimization

An assistant that serves the same user over a long horizon has to answer from what that user has revealed: which preferences still hold, which were revised, and which constraints apply now. Retaining that information is not the same as acting on it, and the two are usually optimized as if they were. Keeping the informa...

Jing-Xuan Wu, Yuzhe Yang, Yi-Qiao Huang et al. · 0 citations
#natural language process... Preprint Open access Sep 2026

Eternal Sunshine of the Spotless Mind: Systematically Erasing LLM's Memories

We consider persistent LLMs that accumulate memories of their interactions with a user over time. Such LLMs maintain memories using external storage, which they can query to overcome the limitations of a fixed context window. Such systems have numerous practical applications, as they can draw on all past interactions w...

Olga Ohrimenko · 0 citations
#natural language process... Preprint Sep 2026

DeepRewind: Predicting and Repairing Premature Commitments in Deep Research Agents

Deep-research agents conduct long-horizon investigations through iterative search, evidence evaluation, belief revision, and synthesis. However, they may commit to claims before sufficient evidence is available, causing later reasoning to reinforce an incorrect interpretation. We introduce DeepRewind, an additive contr...

Amirhossein Abaskohi, Amirhossein Dabiriaghdam, Le-Le Wang et al. · 0 citations
#natural language process... Preprint Sep 2026

Learning from Teacher Continuations at Student States

We present OLIVE (OnLine InterVEntion). At each iteration, the evolving student policy generates a new prefix, the teacher continues it autoregressively, and the student is updated using cross-entropy computed on the teacher-generated tokens. Each design choice targets a corresponding limitation of existing distillatio...

Hao-Jin Wang, Dylan Zhang, Huai-Bo Chen et al. · 0 citations

From tech blogs

See all →
MIT News · Artificial Intelligence Sep 24, 2026

Estimating suicide risk from text

A new language-processing tool could help identify the highest-risk individuals from natural language, enabling swifter interventions.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.