Skip to content

Category

natural language processing

6,757 papers

#natural language process... Preprint Oct 2026

Scaling and Distilling Text Embeddings for Better Diffusibility

Diffusion language models (DLMs) offer a promising alternative to autoregressive (AR) language generation. Recent advances in continuous DLMs, which apply latent diffusion to continuous text embeddings, raise a practical question: which embedding makes the best latent space, i.e., the most diffusible? To answer this, w...

Ze-Kai Zhang, Yun-Jie Tian, Yan-Jin He et al. · 0 citations
#natural language process... Preprint Oct 2026

Role-aware Heuristic Episodic Attention for Conversational LLMs

Large language models often lose track of persistent instructions and relevant information as multi-turn conversations grow. We study this cumulative contextual decay through three related failure modes: attention pollution, dilution, and drift. We propose REA (Role-aware Heuristic Episodic Attention), a context-manage...

Wan-Yang Hong, Zhao-Ning Zhang, Yi Chen et al. · 0 citations
#natural language process... Preprint Open access Oct 2026

Beyond Leaderboards: Tokenomics of Agentic Small Language Model Ensembles

As large language models (LLMs) move from standalone assistants into agentic workflows, evaluation must extend beyond scalar leaderboard accuracy to account for operational reliability, cost, latency, and token efficiency. We use an agentic ensemble of small language models (SLMs) with an SLM-judge-mediated feedback lo...

Alexei N. Skurikhin, Emily M. Taylor, Nathan A. DeBardeleben · 0 citations

Efficient Task Adaptation in Large Language Models: A Survey of Weight-Based, Prompt-Based, and Embedding-Based Adaptations

As large language models are increasingly deployed across diverse downstream tasks, efficient task adaptation has emerged as a central challenge. In response, a wide range of task adaptation methods have been proposed, spanning parameter-efficient fine-tuning, in-context learning, and embedding-injection approaches. Ho...

Jungwon Park, Changin Choi, Jimyeong Kim et al. · 0 citations
#natural language process... Preprint Oct 2026

DeBERTa-ConPara: Attack-Aware and Deployment-Realistic Detection of AI-Generated Text

Robust detection of AI-generated text under deployment conditions is challenging: distribution shifts across domains and generators, adversarial perturbations of the input surface, and the absence of target-domain labels for threshold calibration all degrade detectors that perform well in-domain. We present DeBERTa-Con...

Mohamed Mady, Yu-Pei Li, Johannes Reschke et al. · 0 citations
#natural language process... Preprint Oct 2026

Child-Adapted Structured Phonological Representations for Interpretable Speech Sound Analysis

Structured phonological representations provide an interpretable alternative to generic speech embeddings, but existing models are largely trained on adult speech. We adapt PhonoQ-2.0 to child speech using CHILDES-Aligned data and compare three alignment-supervision conditions (Adult, Adult+Child, and Child-only) acros...

Abner Hernandez, T. A. Vergara, Andreas K. Maier et al. · 0 citations

Can large language models unlock discrete data in ophthalmic diagnostic reports?

Objective: To assess the accuracy and efficiency of a large language model (LLM) using two prompt strategies to extract structured data from ophthalmic diagnostic PDF reports. Methods: Twenty deidentified reports across four types (Visual Field, OCT Glaucoma Overview, OCT retinal nerve fiber layer Single Exam, and OCT...

Umair A. Zaidi, An-Lun Wu, Wei-Chun Lin et al. · 0 citations
#natural language process... Preprint Open access Oct 2026

Effective Synthetic Data Curation Requires Group-Level Signals

Synthetic data now is essential to LLM training, used to strengthen advanced capabilities such as autonomous and long-horizon task execution. Yet recent work shows that training on it at scale can degrade model generation, making it important to decide what synthetic data is worth training on. While current data curati...

Cathy Jiao, Chenyan Xiong · 0 citations
#natural language process... Preprint Sep 2026

Towards Robust Numerical Claim Verification

Large language models (LLMs) are widely used for claim verification, yet remain brittle for numerical reasoning: even small changes in value can sharply degrade accuracy. We show that this brittleness persists in frontier LLMs, but can be mitigated through adversarial fine-tuning on numerically perturbed examples. Usin...

Peter Røysland Aarnes, Vinay Setty · 0 citations
#natural language process... Preprint Sep 2026

Bayesian Fine-tuning Yields Language Models that are as Bayesian as their Beliefs Allow

Language models (LMs) are increasingly used for tasks that require reasoning about hidden variables from a few observations, for which Bayesian inference is the normatively correct solution. While supervised fine-tuning of an LM on the outputs of an optimal $\textit{Bayesian}$ model leads to near-Bayesian behavior, sta...

Polina Tsvilodub, Andreas Waldis, Lin-Lu Qiu et al. · 0 citations
#natural language process... Preprint Sep 2026

PhysicsMate: A Curriculum-Grounded Bengali Benchmark for Secondary Physics QA with Small-Model Adaptation

Bengali secondary education lacks curriculum-grounded benchmarks for STEM question-solving, and general-purpose language models struggle with the precise terminology, unit conventions, and derivations that physics problems demand. We introduce PhysicsMate, a benchmark of 1834 question-answer pairs built from the Nation...

Rashid Azraf Jahin, Saadman Sajid, Khan Raiyan Ibne Reza et al. · 0 citations
#natural language process... Preprint Sep 2026

Lingtai: What Concept Geometry Reveals--and Does Not Reveal--About LLM Inference

Observing what a large language model computes during autoregressive inference--online and without training probes--remains difficult. We introduce Lingtai, a training-free concept telemetry layer: at each generation step, residual states are projected onto a domain-specific bank of named concept anchors, constructed w...

Jian-Gang Chen · 0 citations

From tech blogs

See all →
MIT News · Artificial Intelligence Sep 24, 2026

Estimating suicide risk from text

A new language-processing tool could help identify the highest-risk individuals from natural language, enabling swifter interventions.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.