Skip to content

Category

natural language processing

6,613 papers

#natural language process... Preprint Oct 2026

Ontological Instability and Statistical Amplification: The Paradox of"Humanizing"LLM-Generated Text

Supervised AI-text detectors report high benchmark accuracy, but it is not clear what their decisions are based on. We analyze a RoBERTa-based detector under semantic, structural, and tokenizer-level perturbations, using the M4 dataset (N = 10,000) and controlled generations (N = 300). When Mistral-7B-Instruct was aske...

Claudiu Creanga, Liviu P. Dinu · 0 citations
#natural language process... Preprint Oct 2026

Emergent Structure in the Marginal Attention Space of Language Models

While representation similarity across independently trained language models is well-documented, how internal mechanics such as attention behave across models remains far less characterized. Inspired by this gap, we examine the structure of post-softmax attention weights by marginalizing over query positions, mapping t...

Valentino Maiorca, Walter Nelson, Francesco Locatello · 0 citations

An automated pipeline for standardised speech-unit annotation in spontaneous dialogue

Quantifying conversational dynamics requires reliable identification of interactional units and their temporal boundaries, but speech activity alone does not distinguish conversational turns from listener feedback or within-turn pauses. We present an automated pipeline for extracting turns and backchannels from separat...

Han-Lu He, H. V. Skat-Rørdam, I. Örnólfsson et al. · 0 citations
#natural language process... Preprint Open access Oct 2026

Unmasking Propaganda: A Comparative Analysis of Masked and Causal Language Models

Propaganda detection is an essential task in natural language processing (NLP), particularly in the context of manipulative political communications. However, identifying specific propaganda techniques presents a significant challenge due to their often subtle nature and reliance on context, making them difficult to di...

Claudiu Creanga, Ioachim Lihor, Liviu P. Dinu · 0 citations
#natural language process... Preprint Oct 2026

HARPO: Hallucination-Aware Reinforcement Learning for Faithful and Creative Language Generation

Large Language Models (LLMs) are prone to generating hallucinated content, which compromises their reliability in knowledge-intensive tasks. To address this challenge without sacrificing creativity, we propose HARPO, a reinforcement learning framework designed to jointly optimize faithfulness and creativity. HARPO inco...

Tie-Zheng Yu, Yu-Xin Jiang, Jin-Peng Li et al. · 0 citations
#natural language process... Preprint Open access Oct 2026

The Geometry of Knowledge Accessibility in Large Language Models

Large language models (LLMs) contain broad knowledge, but they cannot access all of it reliably. We study this problem through knowledge accessibility, which describes whether the knowledge needed for a query can be recalled from the model. We find that knowledge accessibility has a simple geometric structure in the mo...

Lihu Chen · 0 citations
#computer vision Preprint Open access Oct 2026

Recursive Self-Improvement in Unified Multimodal Models

Unified multimodal models (UMMs) understand and generate both text and images, which lets a model produce its own training data. Existing self-improvement in UMMs keeps supervision on the visual side, where image understanding judges image generation. We propose recursive cross-capability self-improvement (RSI), a trai...

Huijuan Wang, Chufan Shi, Cheng Yang et al. · 0 citations
#natural language process... Preprint Open access Oct 2026

OmniConfess: Eliciting Token Confessions to Mitigate Omni-Modal Hallucination

Omni-modal large language models (OmniLLMs) unify text, images, audio, and video, yet hallucinate when generation relies on the wrong evidence. Existing inference-time methods can reduce hallucinations, but rarely reveal which evidence sustains a generated commitment. We introduce OmniConfess, a training-free method fo...

Huiqiang Rong, Haoran Luo, Hui Feng et al. · 0 citations
#natural language process... Preprint Open access Oct 2026

OLMo-Detect: A Multi-Stage, Confounder-Controlled Benchmark for Membership Inference on Large Language Models

Membership inference on large language models (LLMs) aims to determine whether a given text sample was included in an LLM's training data, without access to its training corpus. Despite recent progress, existing benchmarks suffer from three limitations: limited coverage of training stages, insufficient distributional a...

Tao Shi, Chaoyi Xiang, Qiongkai Xu et al. · 0 citations
#natural language process... Preprint Open access Oct 2026

A Guideline-Augmented Multi-Agent Framework for Schema-as-Code Biomedical Named Entity Recognition

Large language models (LLMs) have shown promising potential for biomedical named entity recognition (BioNER) through instruction following and in-context learning. However, existing LLM-based BioNER methods still face two key limitations. First, retrieved demonstrations and external biomedical knowledge provide limited...

Songtao Li, Yijia Zhang, Shidi Zhang et al. · 0 citations
#natural language process... Preprint Oct 2026

Enhancing Biomedical Named Entity Recognition via Multiple Programming Languages Instruction Tuning and Ensemble Method

Instruction tuning has become a common paradigm for applying large language models (LLMs) to biomedical named entity recognition (BioNER). However, existing instruction-tuning approaches still face two key challenges. First, conventional natural-language instructions typically serialize BioNER annotations as flat textu...

Song-Tao Li, Yi-Jia Zhang, Jian-Yuan Yuan et al. · 1 citation

Output Language Confusion under Multilingual Prompt Contamination

Standard factual benchmarks assume clean monolingual prompts and exact-match scoring, two assumptions that break simultaneously in real-world multilingual deployment, from retrieval-augmented generation pipelines returning mixed-language passages to users pasting multilingual web content. We introduce Multilingual Dist...

Riju Marwah, Ritvik Garimella, Khusham Bansal et al. · 0 citations

From tech blogs

See all →
MIT News · Artificial Intelligence Sep 24, 2026

Estimating suicide risk from text

A new language-processing tool could help identify the highest-risk individuals from natural language, enabling swifter interventions.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.