Skip to content

Category

natural language processing

6,757 papers

#artificial intelligence Preprint Sep 2026

How Divergence Becomes Decision Flips in Compressed Language Models

Compression reports summarize how far a compressed language model moved from the dense one, usually by a KL divergence; a deployment that relies on the dense model's outputs needs to know how many of its decisions changed. We show that total variation, not KL, answers this directly. Across 802 compressed and perturbed...

Beatriz Almeida Felício · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Closing the Loop: Practical Training Recipes for Looped Language Models

Looped language models increase effective depth by repeatedly applying a shared block of layers, but existing large-scale recipes require multi-stage training over trillions of tokens, while the benefits of recurrence remain difficult to separate from differences in data and training. In this work, we establish practic...

Andrei Marchenko, Viacheslav Bezrukov, Oleg Kashurin et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Self-Evolving Coding Rules for AI Coding Agents

The performance of AI coding agents is highly dependent on their underlying coding rules. However, existing coding rules are typically hand-crafted and fixed, making the process labor-intensive and often suboptimal. In this work, we propose RuleEvolve, a self-evolving framework for coding rules. RuleEvolve maintains a...

Zheng-Yuan Jiang, Reachal Wang, Yue-Peng Hu et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Where's Waldo? Query-language Preference under Cross-lingual Knowledge Disparities

Large Language Models increasingly serve as interfaces for knowledge-intensive information seeking tasks across languages by synthesizing multilingual evidence. Prior work has shown that they often exhibit query-language preference -- the tendency to favor sources written in the language of the query -- but has largely...

Dayeon Ki, Ruochen Zhang, Silviu Cucerzan et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Emergent Unfaithfulness: How Alignment Training Causes Language Models to Silently Override Task Faithfulness

Large language models are characterized by three key properties: capability, alignment, and faithfulness. Prior work studies the tradeoffs between capability and alignment, and between capability and faithfulness, but a third tension remains underexplored: the alignment-faithfulness conflict. We show that aligned model...

Pardis Sadat Zahraei, Janvijay Singh, Gokhan Tur et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Can LLMs Reason Over Long Horizons? An Empirical Evaluation of Context Strategies for Longitudinal Clinical Reasoning

Longitudinal clinical reasoning requires large language models (LLMs) to identify and integrate relevant evidence distributed across extended patient histories. Although long-context models can process increasingly large amounts of information, providing more history does not necessarily make relevant evidence more acc...

Taye Akinrele, Noorbakhsh Amiri Golilarz, Subash Neupane et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Rules Amortize, Pairings Don't: Linguistic Structure Determines What Latent Task Representations Can Replace In-Context Learning

In-context learning (ICL) can be amortized into latent objects (task vectors, function vectors, context vectors) that recover few-shot behavior at zero-shot inference cost, but recent theory shows a static vector acts as a single synthetic demonstration and must fail on high-rank mappings such as word-level bijections....

Gunmay Jhingran · 0 citations
#artificial intelligence Preprint Sep 2026

EurekaBench: Measuring Agentic Ability to Discover New Scientific Insights

When Isaac Newton discovered the law of gravitation, he did so through an iterative process of analyzing observed data such as planetary patterns, finding the underlying mechanisms by describing patterns in mathematical equations, and refining his theory against the Moon's orbit, revealing the startling insight that th...

Jia-Yi Geng, Zhengxuan Wu, Kevin S. Chen et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

FAER: Auditable Utility-Aligned Trajectory Replay for Language Model Post-Training

Replay selectors often rank cached trajectories by format feedback, confidence, freshness, or response length, although cache-level correctness and downstream learner utility are distinct objectives. We formalize this selection-to-learning gap and introduce FAER as an auditable full-trajectory replay framework. Its tra...

Miaobo Hu, Shuhao Hu, Xiaobo Guo et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Faithful Chart Generation for Multimodal Deep Research: Frame-Evidence Co-Adaptation

Analytical charts in multimodal deep research encode quantitative claims, requiring every visualized value to be faithfully grounded in supporting evidence. Unlike retrieved images that mainly provide contextual information, charts require numerical fidelity: visualized values should not only match retrieved evidence q...

Yuxin Yue, Yingchen Zhang, Ruqing Zhang et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

A Shared Taste for Model-Written Text: The Generator-by-Selector Matrices of "AI-AI Bias" Show No Detectable Own-Model Premium

Laurito et al. (PNAS 2025) showed that large language models choosing between two descriptions of the same product, paper or film prefer the description written by a language model over the one written by a person, by a wide margin over what human judges do. Their design crosses five generators with the same five model...

Dmitrij \.Zatuchin · 0 citations
#artificial intelligence Preprint Open access Oct 2026

LEGO-OPD: Factorized Teacher Composition for Multimodal On-Policy Distillation

Multimodal on-policy distillation (OPD) aims to improve visual grounding while preserving the strong reasoning capabilities of language models. Recent multi-teacher approaches combine LLM and VLM teachers to provide complementary supervision. However, directly using a VLM's full predictive distribution entangles its vi...

Jaeyun Shin, Hangeol Chang, Jong Chul Ye · 0 citations

From tech blogs

See all →
MIT News · Artificial Intelligence Sep 24, 2026

Estimating suicide risk from text

A new language-processing tool could help identify the highest-risk individuals from natural language, enabling swifter interventions.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.