Skip to content

Category

natural language processing

7,304 papers

#artificial intelligence Preprint Open access Oct 2026

When Scientific Contradictions Are Lost in Translation

Two scientific findings can disagree without contradicting each other. Determining whether they conflict requires knowing whether they describe comparable measurements. We study how language models behave at this decision point. In a controlled task, we generate an unsatisfiable XOR constraint system and translate its...

Tal Zeevi, Trey W. Jensen, Maxwell Strome · 0 citations
#artificial intelligence Preprint Sep 2026

Towards Model as a Library: Offline, Community-Sourced AI for Low-Resource African Languages

This paper introduces MaaL, a software architecture that packages small, community-enrolled speech models as versioned on-device dependencies, enabling offline structured data collection that cannot generatively hallucinate, for populations that current language models serve worst.

F. Jean Louis · 0 citations
#artificial intelligence Preprint Sep 2026

Reach Into The CHOIR: Free-List Elicitation Uncovers Distinct Model Voices in LLM Ensembles

Open-ended LLM homogeneity can create false plurality when several systems appear to offer independent perspectives while returning the same familiar default. Single-pass answers obscure the distinction between agreement produced by a tightly constrained answer space, prompt-vocabulary echo, and broader answer spaces w...

Ben Wigler, M. Tsfasman · 0 citations
#artificial intelligence Preprint Sep 2026

ArgGYM: A Procedural, Engine-Verified Benchmark for Structured Defeasible Reasoning

Recent progress in large language model reasoning has been driven by benchmarks and reinforcement learning environments with automatically verifiable rewards, particularly in mathematics, code, and formal logic. These settings make model accuracy easier to evaluate and optimize, but it remains unclear how far success u...

Ibrahim Ethem Deveci, Funda Tan Çalık, Barış Deniz Sağlam et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Fine-Tuning Diffusion Language Models with Context Selection and Target Weighting

GoldiMask is introduced, which selects tokens to reveal as context by approximately maximizing a submodular objective and weights the remaining targets according to how they benefit from the selected context and their remaining learning potential.

L. Mualem, L. Pastor-Pérez, Vinh Tong et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Beyond Mode Collapse: Generating Diverse Synthetic Expert Conversations via Generative Flow Networks

This work shows that training GFlowNets to generate latent conversation structure using a Gaussian mixture density over key interaction features enables sampling expert strategies in proportion to their prevalence in the training data to provide a stronger training signal than competitive synthesis baselines.

Sumit Asthana, Michael Ion, Kevyn Collins Thompson · 0 citations
#natural language process... Preprint Open access Sep 2026

HPRO: Hierarchical Progressive Reward Optimization via Preference Extraction for Emotional Text-to-Speech

Recently, Large Language Model (LLM)-based Text-to-Speech (TTS) models have achieved remarkable naturalness. However, the standard Supervised Fine-Tuning paradigm often converges to statistically averaged prosody, limiting emotional expressiveness. While preference-driven optimization offers a promising alternative, ex...

Sihang Nie, Xiaofen Xing, Rui Xing et al. · 0 citations
#natural language process... Preprint Open access Sep 2026

CORE-BREW: LLR-Based Soft Decoding for Robust Multi-Bit LLM Watermarking

Reliable provenance for LLM outputs requires multi-bit watermarks that remain robust under editing while maintaining low false-positive rates. Existing ECC-based LLM watermarks rely on hard-decision decoding, discarding token-level reliability information and limiting robustness under post-generation edits. We propose...

Joeun Kim, HoEun Kim, Young-Sik Kim · 0 citations
#natural language process... Preprint Open access Sep 2026

Remember Your Trace: Memory-Guided Long-Horizon Agentic Framework for Consistent and Hierarchical Repository-Level Code Documentation

Automated code documentation is essential for modern software development, providing the contextual grounding that both human developers and coding agents rely on to navigate large codebases. Existing repository-level approaches process components independently, causing redundant retrieval and conflicting descriptions...

Suyoung Bae, Jaehoon Lee, Changkyu Choi et al. · 0 citations
#natural language process... Preprint Open access Sep 2026

Bootstrapping Audiovisual Speech Recognition in Zero-AV-Resource Scenarios

Audiovisual speech recognition (AVSR) combines acoustic and visual cues to improve transcription robustness under challenging conditions but remains out of reach for most under-resourced languages due to the lack of labeled video corpora for training. Synthetic visual data have been shown to be an effective augmentatio...

Pol Buitrago, Javier Hernando · 0 citations
#natural language process... Preprint Jun 2026

Entity tracking emerges in sub-billion parameter language models and exceeds human performance in naturalistic narratives

This work evaluates entity tracking in both language models and humans using naturalistic narratives at multiple levels of complexity, finding that entity tracking degrades specifically with narrative complexity, not narrative length.

K. Drożdż, Micha Heilbron · 0 citations
#natural language process... Preprint Open access Sep 2026

Massive Activations in Hybrid Linear Attention Large Language Models: Pre-Attention Spikes and Inter-Spike Plateaus

We present the first systematic study of massive activations (MAs) in layer-interleaved Hybrid linear attention large language models (HLA LLMs), examining their architectural organization, training-time emergence, underlying mechanisms, and functional significance. Across five linear attention architectures, six hybri...

Zunhai Su, Bohan Sun, Xialie Zhuang et al. · 0 citations

From tech blogs

See all →
MIT News · Artificial Intelligence Sep 24, 2026

Estimating suicide risk from text

A new language-processing tool could help identify the highest-risk individuals from natural language, enabling swifter interventions.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.