Skip to content

Category

natural language processing

6,613 papers

#machine learning Preprint Open access Oct 2026

Have I Seen Enough? Frozen Video-Language Models Encode Evidence Readiness

Streaming video-language models must decide not only what to answer, but whether the evidence needed for the current question has arrived. Existing systems learn that decision as a separate trigger; we ask whether an unmodified model already computes it. We show that frozen VideoLLMs carry a linearly readable evidence-...

Dan Ben-Ami, Kobi Cohen, Chaim Baskin · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Latent space bias directions in LLMs capture confidence, not fairness

Activation steering has gained popularity as a lightweight inference-time debiasing technique for large language models. However, prior work reports that steering vectors generalise poorly, with unintended effects on model performance and limited transfer to new datasets. Our work analyses what the debiasing direction...

Stephanie Buttigieg, Maeve Madigan, Parameswaran Kamalaruban et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Toward Alignment Scaling Laws: A Framework and First Preregistered Measurements

Whether alignment gets easier or harder as models grow is often argued from isolated findings, as if alignment were one property. We treat it as a family of measurable scaling relations: for each risk category r, the alignment burden needed to hold a fixed safety target is modeled as B_r(N)=a_rN^alpha_r, with N a capab...

Jeremy Canale · 0 citations
#machine learning Preprint Open access Oct 2026

UNREAL: Unifying Retrieval and Long-Context with a Single Model

Long-context inference and Retrieval-Augmented Generation (RAG) handle evidence selection at vastly different scales, from a single long prompt to an entire corpus. We ask whether a single model-internal mechanism can select evidence across this range. We introduce UNifying REtrieval And Long-Context with a Single Mode...

Edan Kinderman, Elad Hoffer, Yochai Blau et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Agentic AutoRAG: RAG Pipeline Optimization through Reasoning-Driven Agents

Retrieval-augmented generation (RAG) is a widely used approach for grounding large language models (LLMs) in external knowledge. However, configuring a pipeline is an expensive hyperparameter optimization problem over many interacting choices, from chunking and embedding model to reranking and generation. Existing opti...

Lasse B. Strand, Robert Jakob, Kevin O'Sullivan et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Knowing When Not to Answer: Cross-Domain and Multi-Turn Generalization of Latent Underspecification Signals

Large language models routinely answer questions that cannot be answered from the information given, and in dialogue they answer before enough has been said. Unanswerability is linearly decodable from hidden states, but it is unclear which of its forms share a representation and whether the signal is useful in dialogue...

Jerzy Kami\'nski, Ilya Galyukshev, Artem Kuznetsov et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

CoDe-LoRA: Mitigating the Orthogonality Dilemma in Continual Learning of LLMs via Knowledge Consolidation and Decoupling

Continual learning (CL) is essential for Large Language Models (LLMs) to sequentially adapt to evolving tasks. To mitigate catastrophic forgetting, recent advances implement low-rank adaptation with orthogonal projections (e.g., O-LoRA) to isolate task parameters. However, we reveal that such strict geometric constrain...

Maoqi Liu, Quan Fang, Yufei He · 0 citations
#machine learning Preprint Oct 2026

Making COMET Comparable Across Scripts: Diagnosis and Correction of Tokeniser-Induced Script Bias in Indic MT Evaluation

COMET reports translation quality as a single number, and that number is routinely compared across target languages written in different scripts. Such a comparison assumes Script Invariance: the score should not depend on the writing system that carries the target. We test it on IndicMT Eval by re-encoding the target i...

G. L. John Salvin, Swapnil Hingmire · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Self-Retrospection Distillation: Turning Post-hoc Experiences into Prior Foresight

Reinforcement learning with verifiable rewards (RLVR) turns agent experience into learning signals primarily through scalar outcome rewards after interaction. For group-relative objectives, however, this signal vanishes when all rollouts receive the same reward, even though their trajectories may reveal useful informat...

Haoxiang Zhang, Qinglin Chen, Hiroaki Hayashi et al. · 0 citations
#machine learning Preprint Oct 2026

Language Carries the Expert's Impression: Instrument-Anchored LLM Judges Transfer Counseling-Quality Assessment and Beat In-Domain Training

Automatic assessment of communication quality in dyadic counseling conversations is bottlenecked by data: expert-rated corpora are small and expensive to grow. We study cross-domain transfer of expert overall-impression prediction across three German corpora of simulated counseling (two general-practice medical, one sc...

Tobias Hallmen, Elisabeth André · 0 citations
#artificial intelligence Preprint Open access Oct 2026

DAEDALUS: Bootstrapping Agent Memory from Self-Generated Tasks

LLM agents often lack the operational knowledge to act reliably in new environments, as they must discover specific tool behaviors or environment conventions on their own. Without memory of past attempts, they repeat the same mistakes across tasks, leading to more task failures and longer trajectories. To address this,...

Antoine Edy, Max Conti, Victor Xing et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Isotropic Yet Undecodable: The Sequential Content-Sufficiency Gap in Latent-Predictive Text Representations

We study sequential content sufficiency by investigating whether a representation retains the ordered target information available in its input. An information-theoretic decomposition separates input ambiguity, representation loss, and readout mismatch. We construct recoverable views where perfect agreement and joint i...

K. P. Santoso, N. Z. Fadil, F. P. Harsanti et al. · 0 citations

From tech blogs

See all →
MIT News · Artificial Intelligence Sep 24, 2026

Estimating suicide risk from text

A new language-processing tool could help identify the highest-risk individuals from natural language, enabling swifter interventions.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.