Skip to content

Category

natural language processing

6,613 papers

#natural language process... Preprint Oct 2026

Probe with Participation Trophies: Random-Reward RL as a Probe of LLM Capability

We connect the spurious-reward paradox to a model's reachability and propose random-reward reinforcement learning (RL) as a useful tool for the probing enterprise, addressing a decade-long debate over what probing performance actually reveals about a model. There are two prevailing explanations for the surprising findi...

Yu-Zhu Mao, Lei Yu, Zi-Ning Zhu et al. · 0 citations
#natural language process... Preprint Oct 2026

LawCompass: Navigating from Legal QA to Multi-Agent Deep Research with Grounded Evidence

Recent advances in Large Language Models (LLMs) and Retrieval-Augmented Generation (RAG) have significantly democratized access to legal information. Nevertheless, most existing legal assistants remain confined to multi-turn conversational QA, failing to support complex legal tasks that require systematic evidence retr...

Xiaoxia Cheng, Lin-Nan Wang, Jia-Hao Ma et al. · 0 citations
#natural language process... Preprint Oct 2026

Scaling and Distilling Text Embeddings for Better Diffusibility

Diffusion language models (DLMs) offer a promising alternative to autoregressive (AR) language generation. Recent advances in continuous DLMs, which apply latent diffusion to continuous text embeddings, raise a practical question: which embedding makes the best latent space, i.e., the most diffusible? To answer this, w...

Ze-Kai Zhang, Yun-Jie Tian, Yan-Jin He et al. · 0 citations
#natural language process... Preprint Oct 2026

Role-aware Heuristic Episodic Attention for Conversational LLMs

Large language models often lose track of persistent instructions and relevant information as multi-turn conversations grow. We study this cumulative contextual decay through three related failure modes: attention pollution, dilution, and drift. We propose REA (Role-aware Heuristic Episodic Attention), a context-manage...

Wan-Yang Hong, Zhao-Ning Zhang, Yi Chen et al. · 0 citations
#natural language process... Preprint Open access Oct 2026

Beyond Leaderboards: Tokenomics of Agentic Small Language Model Ensembles

As large language models (LLMs) move from standalone assistants into agentic workflows, evaluation must extend beyond scalar leaderboard accuracy to account for operational reliability, cost, latency, and token efficiency. We use an agentic ensemble of small language models (SLMs) with an SLM-judge-mediated feedback lo...

Alexei N. Skurikhin, Emily M. Taylor, Nathan A. DeBardeleben · 0 citations

Efficient Task Adaptation in Large Language Models: A Survey of Weight-Based, Prompt-Based, and Embedding-Based Adaptations

As large language models are increasingly deployed across diverse downstream tasks, efficient task adaptation has emerged as a central challenge. In response, a wide range of task adaptation methods have been proposed, spanning parameter-efficient fine-tuning, in-context learning, and embedding-injection approaches. Ho...

Jungwon Park, Changin Choi, Jimyeong Kim et al. · 0 citations
#natural language process... Preprint Oct 2026

DeBERTa-ConPara: Attack-Aware and Deployment-Realistic Detection of AI-Generated Text

Robust detection of AI-generated text under deployment conditions is challenging: distribution shifts across domains and generators, adversarial perturbations of the input surface, and the absence of target-domain labels for threshold calibration all degrade detectors that perform well in-domain. We present DeBERTa-Con...

Mohamed Mady, Yu-Pei Li, Johannes Reschke et al. · 0 citations
#natural language process... Preprint Oct 2026

Child-Adapted Structured Phonological Representations for Interpretable Speech Sound Analysis

Structured phonological representations provide an interpretable alternative to generic speech embeddings, but existing models are largely trained on adult speech. We adapt PhonoQ-2.0 to child speech using CHILDES-Aligned data and compare three alignment-supervision conditions (Adult, Adult+Child, and Child-only) acros...

Abner Hernandez, T. A. Vergara, Andreas K. Maier et al. · 0 citations

Can large language models unlock discrete data in ophthalmic diagnostic reports?

Objective: To assess the accuracy and efficiency of a large language model (LLM) using two prompt strategies to extract structured data from ophthalmic diagnostic PDF reports. Methods: Twenty deidentified reports across four types (Visual Field, OCT Glaucoma Overview, OCT retinal nerve fiber layer Single Exam, and OCT...

Umair A. Zaidi, An-Lun Wu, Wei-Chun Lin et al. · 0 citations
#natural language process... Preprint Open access Oct 2026

Effective Synthetic Data Curation Requires Group-Level Signals

Synthetic data now is essential to LLM training, used to strengthen advanced capabilities such as autonomous and long-horizon task execution. Yet recent work shows that training on it at scale can degrade model generation, making it important to decide what synthetic data is worth training on. While current data curati...

Cathy Jiao, Chenyan Xiong · 0 citations
#natural language process... Preprint Sep 2026

Towards Robust Numerical Claim Verification

Large language models (LLMs) are widely used for claim verification, yet remain brittle for numerical reasoning: even small changes in value can sharply degrade accuracy. We show that this brittleness persists in frontier LLMs, but can be mitigated through adversarial fine-tuning on numerically perturbed examples. Usin...

Peter Røysland Aarnes, Vinay Setty · 0 citations
#natural language process... Preprint Sep 2026

Bayesian Fine-tuning Yields Language Models that are as Bayesian as their Beliefs Allow

Language models (LMs) are increasingly used for tasks that require reasoning about hidden variables from a few observations, for which Bayesian inference is the normatively correct solution. While supervised fine-tuning of an LM on the outputs of an optimal $\textit{Bayesian}$ model leads to near-Bayesian behavior, sta...

Polina Tsvilodub, Andreas Waldis, Lin-Lu Qiu et al. · 0 citations

From tech blogs

See all →
MIT News · Artificial Intelligence Sep 24, 2026

Estimating suicide risk from text

A new language-processing tool could help identify the highest-risk individuals from natural language, enabling swifter interventions.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.