Skip to content

Category

natural language processing

7,968 papers

#machine learning Preprint Open access Sep 2026

Watch the Model Think: On-Policy Extraction of Activation Steering Vectors

When a model solves a problem on one attempt and fails it on the next, what separates the two is rarely the final answer token; it is the trajectory that reached it. Contrastive activation steering leaves that signal unused: CAA, SADI, RepE and ITI build their direction from experimenter-supplied text, recorded while t...

Xuanbo Su, Yingfang Zhang, Hao Luo et al. · 0 citations
#machine learning Preprint Open access Sep 2026

Quantifying the Effect of Test Set Contamination on Generative Evaluations

As frontier AI systems are pretrained on web-scale data, test set contamination has become a critical concern for accurately assessing their capabilities. While research has thoroughly investigated the impact of test set contamination on discriminative evaluations like multiple-choice question-answering, comparatively...

Rylan Schaeffer, Joshua Kazdan, Baber Abbasi et al. · 0 citations
#machine learning Conference Jun 2025

AutoSDT: Scaling Data-Driven Discovery Tasks Toward Open Co-Scientists

This work presents AutoSDT, an automatic pipeline that collects high-quality coding tasks in real-world data-driven discovery workflows and is the only automatically collected and the largest open dataset for data-driven scientific discovery.

Yifei Li, Hanane Nour Moussa, Ziru Chen et al. · 11 citations · ⚡1
#machine learning Preprint Nov 2024

Red-Teaming Text-to-Image Models via In-Context Experience Replay and Semantic-Preserving Prompt Rewriting

ICER is a black-box framework that addresses the gap in text-to-image models in harmful content generation through two components: an LLM-based rewriter that produces fluent, natural-language adversarial prompts, and in-context experience replay that accumulates successful jailbreaking patterns into a reusable prior.

Zhi-Yi Chin, Pin-Yu Chen, Wei-Chen Chiu et al. · 2 citations
#machine learning Preprint Sep 2026

Improving Test-Time Scaling with Adaptive Looped Transformers

Looped transformers have demonstrated promising parameter efficiency by reusing layers for latent computation. Prior studies compare looped and non-looped models at matched parameters or per-token FLOPs. However, to the best of our knowledge, whether looping improves test-time scaling as outputs grow longer remains und...

Yi-Chen You, Tianyu Fu, Ao-Song Feng et al. · 1 citation
#machine learning Preprint Sep 2026

Harness Learning Enables Generalizable Test-Time Adaptation

A language-model agent is jointly defined by its model and its harness, the executable program that organizes model calls, tool use, and information flow. Because different tasks call for different ways of organizing these operations, the harness needs to be adapted using feedback from the task at hand. We introduce ha...

Alvin Zhang, Xue-Chen Liu, Zi-Xuan Wang et al. · 0 citations
#machine learning Preprint Sep 2026

CoSE-E: A Benchmark for Code-switched Speech Evaluation in Enterprise Settings

A CS-ASR synthetic benchmark and multidimensional evaluation framework tailored to enterprise domains, systematic evaluation of frontier ASR systems across 5 language pairs, and diagnostic analysis of the additional transcription errors that code-switching introduces across language pairs and models are proposed.

Shama Gupta, Hoang Nguyen, Chelsea Huang et al. · 0 citations
#machine learning Preprint Open access Sep 2026

Which the Eye Fears: Writing with Read-Blindness Explains Massive Activations in Transformers

Massive activation features (MAs) in Transformers are extreme-value residual-stream features that persist across layers despite the model's ability to suppress them. Why do they survive? Our investigation using an operator-level mechanistic analysis of attention and feed-forward (FFN) blocks reveals that these blocks s...

Swagatam Mukhopadhyay, Vishal Vivek Saley, Vraj Parikh et al. · 0 citations
#machine learning Preprint Open access Sep 2026

N\"urnberg NLP at ChildSafeAds 2026: Structurally Dissimilar Voter Ensembles under Four Levels of Data Access

We describe the N\"urnberg NLP system for ChildSafeAds 2026. The shared task asks what a monitoring system for commercial content in child-facing YouTube videos can achieve at a given level of data access. We answer with per-subtask ensembles of nine voters, organised into three branches that differ in backbone, adapta...

Philipp Steigerwald, Eric Rudolph, Jens Albrecht · 0 citations
#machine learning Preprint Sep 2026

The Model Knows When to Stop: Training-Free Early Stopping for Long-Context Reading

Answer-Convergence Stopping (ACS) is introduced, a training-free stopping rule that measures rather than asks, and reveals that by properly utilizing the output signals of frozen models, it can achieve favorable behaviors like adaptive stopping without the need for additional training.

Muath Alyobi, M. Eltahir, Almoayyad Abuljdail et al. · 0 citations
#machine learning Preprint Sep 2026

Rethinking Latent Visual Reasoning: Grounding Latent Reasoning in Visual Evidence

ReaLVR is proposed, which brings visual-evidence supervision to the model's own free-running latent trajectories, and is the first to scale visual reasoning in latent space, showing that the framework continues to deliver robust improvements at frontier model scales up to 235B.

Xi Xiao, Tian-Chen Zhao, Youngeun Kim et al. · 0 citations
#machine learning Preprint Sep 2026

RoPE is Dead, Long Live RoPE: Towards Scalable Data-aware Positional Encodings

Transformers process tokens without any inherent notion of order, making positional encoding a fundamental requirement rather than an architectural refinement. Rotary Position Embedding (RoPE) has become the default positional encoding in modern language models, yet it is heavily biased toward nearby tokens. Existing a...

Jarod Lévy, Mathurin Videau, Jad Yehya et al. · 0 citations

From tech blogs

See all →
MIT News · Artificial Intelligence Oct 15, 2026

AI model decodes the language cells use to communicate

A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.

Microsoft Research Blog Oct 15, 2026

Proof-based general-purpose computing with Magnetar

Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.

MIT News · Artificial Intelligence Sep 24, 2026

Estimating suicide risk from text

A new language-processing tool could help identify the highest-risk individuals from natural language, enabling swifter interventions.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.