Skip to content

Category

natural language processing

6,613 papers

#artificial intelligence Preprint Oct 2026

Attention Tax, Handoff Tax: A Stylised Model of When Multi-Agent LLM Systems Help

Recent work on multi-agent LLM systems reaches sharply different conclusions: some results show that a single agent with the same information and compute should dominate a delegated system, others that multi-agent gains grow with task depth. We argue that much of the disagreement comes from modelling different bottlene...

A. Anchan, Nayonika Sen · 0 citations
#artificial intelligence Preprint Oct 2026

ROT: Rotating Hidden States towards Contextual Vectors for Hallucination Mitigation in LVLMs

Large Vision-Language Models (LVLMs) frequently suffer from object hallucination. Existing training-free interventions primarily manipulate attention weights, which indirectly affect the deep semantics reaching the final predictive layers. In this work, we shift our focus to the hidden state vectors extracted after sel...

Yi-Jin Du, Xiang-Cheng Zhan, Shuo Yang · 0 citations
#artificial intelligence Preprint Oct 2026

Backdooring Sparse Autoencoders

Sparse autoencoders (SAEs) are increasingly used not only to interpret language models but also to intervene on their internal representations. We show that this creates a supply-chain attack surface: a maliciously modified SAE can induce attacker-chosen behavior when inserted into the forward pass of an otherwise unch...

E. Ahlers, Daniel Passon, Tobias Kiecker et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

LightMTP: Lightweight Latent Multi-Token Prediction

Next-token prediction (NTP) is the standard pretraining objective for large language models, yet it provides an explicit training signal only for the immediate next token, which can lead models to exploit local patterns instead of capturing longer-range structure and ideas. Multi-token prediction (MTP) addresses this b...

Tamara Czinczoll, Julie Kallini, Gerard de Melo et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Differentiable Bit-Widths: Co-optimizing Pruning and Quantization via SVD for Ultra-Efficient LLM Compression

SVD-based pruning and quantization have recently emerged as a promising strategy for the ultra-efficient compression of large language models. In these methods, compression is performed in two stages: components are first truncated, and the remaining ones are subsequently quantized. Although this decoupled pipeline ben...

Hankyul Kang, Jongbin Ryu · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Investigating Query-Insensitive Behavior in Spatio-Temporal Video Grounding

Spatio-temporal video grounding (STVG) aims to localize objects or events described by natural language queries in both space and time. Existing STVG models are typically trained and evaluated under the assumption that each query is relevant to the input video. In this work, we challenge this assumption by studying the...

Eryk Ko{\l}odziejczyk, Alberto Presta, Karol Szurkowski et al. · 0 citations
#artificial intelligence Preprint Oct 2026

HuatuoGPT-3: RL-Only Domain Adaptation from Base Models

Domain adaptation aims to turn a general-purpose large language model (LLM) into an expert for a target domain. While the dominant SFT+RL pipeline offers a convenient cold start, it may reduce exploration diversity and introduces additional complexity through multi-stage optimization. These limitations motivate RL-only...

Junying Chen, Xin-Yuan Xie, Zi-Niu Li et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

TasteRoute: Personalized Routing for Video Generation

Rapid progress in video generation has led to a plethora of models that differ substantially in capability and generation cost. This raises a natural question: can each request be efficiently routed to an appropriate model? We find that even when the consensus of the other annotators is used as an oracle, it agrees wit...

Zhi Rui Tam, Chao-Chung Wu, Sin-Han Yang et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Off-Policy Merging Beats On-Policy Self-Distillation for Continual Learning

A long-standing goal of AI is a model that can continually learn and improve itself. On post-trained models, supervised finetuning (SFT) on new data often causes poor generalization and catastrophic forgetting. As such, the conventional wisdom is that on-policy training is a prerequisite for continual learning. In prac...

C. Wu, Thomas T. Zhang, Aditi Raghunathan · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Selecting Long-Horizon Trajectories for Reliable and Efficient Terminal-Agent Training

Terminal agents are commonly trained by imitating long teacher trajectories, yet how much of each trajectory to supervise remains unexplored. We study the \emph{supervision horizon}, the number of trajectory tokens retained for training, and show that it is a key design axis for reliability and cost. Reliability improv...

Cuong Dang, Hoang Anh Just, Ruoxi Jia · 0 citations
#artificial intelligence Preprint Open access Oct 2026

CLARA: Can AI Assess Developmental Appropriateness in Children's Stories?

Assessing the developmental suitability of children's narratives is important for educational recommendation and developmental literacy research, yet such assessment typically relies on subjective and difficult-to-scale human judgment. This raises an important question: Can AI systems approximate human developmental ju...

Sijing Yin, Zirui Wang, Qian Liu et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Knowing the Rules, Applying the Rules: Evaluating Language Models on Traditional Chinese Bazi

Knowing domain rules does not guarantee applying them to a case. We study this distinction in traditional Chinese Bazi through 3,000 Chinese multiple-choice questions spanning 14 Theory and 11 Case categories. Six endpoint systems are evaluated, with primary results reported on a 2,492-item model-informed refinement. T...

Jiulin Li, Ping Huang · 0 citations

From tech blogs

See all →
MIT News · Artificial Intelligence Sep 24, 2026

Estimating suicide risk from text

A new language-processing tool could help identify the highest-risk individuals from natural language, enabling swifter interventions.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.