Skip to content

Category

natural language processing

6,613 papers

#natural language process... Preprint Open access Oct 2026

RubricArmor: Adversarial Evolution Improves LLM-Based Rubric Generation

Rubric-based reinforcement learning (RL) provides interpretable rewards for aligning large language models (LLMs) by evaluating responses against query-specific evaluation criteria. To construct rubrics at scale, a straightforward approach to LLM-based rubric generation is to prompt an LLM to generate a rubric directly...

Haocheng Yang, Yuchao Zhang, Licheng Pan et al. · 0 citations
#natural language process... Preprint Open access Oct 2026

Red-TTT: Test-Time Training for Automated Jailbreaking Large Language Models

Large language models remain vulnerable to jailbreaks, and automated red teaming is the standard way to find jailbreaks in large language models at scale. Current methods either draw more samples at test time through search, rewriting, and tree expansion, or train a stronger attacker offline with reinforcement learning...

Tongyan Hu, Hao Li, Xiaogeng Liu et al. · 0 citations
#natural language process... Preprint Oct 2026

Inductive Claims Extraction at Scale

A large part of political discourse on social media is built and expressed at a level of claims: i.e. declarative, typically single-clause statements, which convey a particular interpretation of reality and can range from factual to evaluative. Moreover, rather than occurring randomly, claims coalesce, recur in pattern...

Sandrine Chausson, Björn Ross · 0 citations
#natural language process... Preprint Open access Oct 2026

Verification Trap: Understanding Test-Time Selection Failures under False Premises in Code Generation

Test-time compute has become a central way to improve code generation: systems sample multiple candidate programs and use verifier-visible evidence to select the final output. This paradigm implicitly assumes that the verifier provides a corrective signal independent from the generator. We challenge this assumption und...

Feng He, Hejia Wang, Linghao Meng et al. · 0 citations
#natural language process... Preprint Open access Oct 2026

Selecting Repetition Counts Across Model Scales in Data-Constrained Pretraining

The repetition count that works best for a small language model may not remain best at a larger scale. We study this effect in pretraining with a finite target corpus mixed with generic data at a fixed target fraction. On Wikipedia-derived data and Proof-Pile-2, the ranking of measured repetition counts changes with mo...

Ziyue WANG, T. Kanamori · 0 citations
#natural language process... Preprint Open access Oct 2026

Belief-Trajectory Energy: Measuring the Path to a Prediction

Large language models (LLMs) progressively revise their predictions across Transformer layers, yet we typically observe only the final output, discarding the trajectory through which it is formed. We introduce Belief-Trajectory Energy(BTE), a model-grounded measure that characterizes an input through the layerwise pred...

Jiahao Ying, Wei Tang, Boxian Ai et al. · 0 citations
#natural language process... Preprint Open access Oct 2026

InstMoE: Adaptive Multimodal Routing with Specialized Experts

Multimodal inputs are inherently heterogeneous, not only across modalities but also in the information pathways required for effective prediction. To address this limitation, we propose InstMoE, an adaptive expert routing framework for multimodal learning. InstMoE dynamically routes each input to specialized unimodal a...

Guimin Hu, Xiang He, Yingjian Li et al. · 0 citations
#natural language process... Preprint Oct 2026

Small Agents with Semantic Search: Efficient Multilingual Code Localization

Locating relevant files from natural-language requests is a core subtask for agents operating over code repositories. We investigate whether this task can be delegated to compact, specialized models to enable on-device search while reducing the token usage, latency, and inference cost of larger agents. We show that sem...

Maxence Lasbordes, Aarush Sinha, Raphaël Sourty et al. · 0 citations
#natural language process... Preprint Oct 2026

How Much Do LLM-as-a-Judge Design Choices Matter? A Systematic Comparison of Prompt Designs, Rating Scales, and Models

Researchers increasingly use Large Language Models as judges (LLM-as-a-judge) to evaluate model outputs. Yet there are no standards for how to design these judges. Typically, researchers choose the prompt, rating scale, and model intuitively. If these choices change the judge's verdicts, two studies can reach different...

Laurène Vaugrante, Thilo Hagendorff · 0 citations
#natural language process... Preprint Open access Oct 2026

Towards cross-cultural study of folksong lyrics with machine translation

Music is universally present in human societies. Ethnomusicologists have long been documenting the diverse expressions of human musicality, and comparative musicology has recently brought several studies of folksong to a more global scale. Such cross-cultural research has not been conducted on lyrics: the language barr...

Anna Dvo\v{r}\'akov\'a, Anna Aljanaki, Danbinaerin Han et al. · 0 citations
#natural language process... Preprint Open access Oct 2026

Usage-Modulated Sentiment Representations in Large Language Models

Prior work suggests that sentiment can often be captured by approximately linear directions in LLM activation spaces, but a single direction may not fully capture sentiment representations. In natural communication, sentiment is shaped not only by polarity but also by usage factors, such as tone and audience adaptation...

Hongfei Du, Jiacheng Shi, Yanfu Zhang et al. · 0 citations
#natural language process... Preprint Open access Oct 2026

Causal Improvement Graph for Agentic Harness Optimization

Agentic Harness is the runtime that constructs task context and controls execution flow, thereby shaping overall agent performance. Given a fixed model and external evaluation, automated Harness optimization seeks to improve this runtime through an iterative proposal--evaluation loop to better solve target tasks. Exist...

Junjie Zhang, Shunyu Liu, Haoyu Wang et al. · 0 citations

From tech blogs

See all →
MIT News · Artificial Intelligence Sep 24, 2026

Estimating suicide risk from text

A new language-processing tool could help identify the highest-risk individuals from natural language, enabling swifter interventions.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.