Skip to content

Category

natural language processing

6,756 papers

#artificial intelligence Preprint Sep 2026

ArgGYM: A Procedural, Engine-Verified Benchmark for Structured Defeasible Reasoning

Recent progress in large language model reasoning has been driven by benchmarks and reinforcement learning environments with automatically verifiable rewards, particularly in mathematics, code, and formal logic. These settings make model accuracy easier to evaluate and optimize, but it remains unclear how far success u...

Ibrahim Ethem Deveci, Funda Tan Çalık, Barış Deniz Sağlam et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Fine-Tuning Diffusion Language Models with Context Selection and Target Weighting

GoldiMask is introduced, which selects tokens to reveal as context by approximately maximizing a submodular objective and weights the remaining targets according to how they benefit from the selected context and their remaining learning potential.

L. Mualem, L. Pastor-Pérez, Vinh Tong et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Beyond Mode Collapse: Generating Diverse Synthetic Expert Conversations via Generative Flow Networks

This work shows that training GFlowNets to generate latent conversation structure using a Gaussian mixture density over key interaction features enables sampling expert strategies in proportion to their prevalence in the training data to provide a stronger training signal than competitive synthesis baselines.

Sumit Asthana, Michael Ion, Kevyn Collins Thompson · 0 citations
#natural language process... Preprint Open access Sep 2026

HPRO: Hierarchical Progressive Reward Optimization via Preference Extraction for Emotional Text-to-Speech

Recently, Large Language Model (LLM)-based Text-to-Speech (TTS) models have achieved remarkable naturalness. However, the standard Supervised Fine-Tuning paradigm often converges to statistically averaged prosody, limiting emotional expressiveness. While preference-driven optimization offers a promising alternative, ex...

Sihang Nie, Xiaofen Xing, Rui Xing et al. · 0 citations
#natural language process... Preprint Open access Sep 2026

CORE-BREW: LLR-Based Soft Decoding for Robust Multi-Bit LLM Watermarking

Reliable provenance for LLM outputs requires multi-bit watermarks that remain robust under editing while maintaining low false-positive rates. Existing ECC-based LLM watermarks rely on hard-decision decoding, discarding token-level reliability information and limiting robustness under post-generation edits. We propose...

Joeun Kim, HoEun Kim, Young-Sik Kim · 0 citations
#natural language process... Preprint Open access Sep 2026

Remember Your Trace: Memory-Guided Long-Horizon Agentic Framework for Consistent and Hierarchical Repository-Level Code Documentation

Automated code documentation is essential for modern software development, providing the contextual grounding that both human developers and coding agents rely on to navigate large codebases. Existing repository-level approaches process components independently, causing redundant retrieval and conflicting descriptions...

Suyoung Bae, Jaehoon Lee, Changkyu Choi et al. · 0 citations
#natural language process... Preprint Open access Sep 2026

Bootstrapping Audiovisual Speech Recognition in Zero-AV-Resource Scenarios

Audiovisual speech recognition (AVSR) combines acoustic and visual cues to improve transcription robustness under challenging conditions but remains out of reach for most under-resourced languages due to the lack of labeled video corpora for training. Synthetic visual data have been shown to be an effective augmentatio...

Pol Buitrago, Javier Hernando · 0 citations
#natural language process... Preprint Open access Sep 2026

Entity tracking emerges in sub-billion parameter language models and exceeds human performance in naturalistic narratives

Understanding language requires tracking entities across discourse - i.e., knowing where things are and how they change, even when not explicitly stated. Whether language models perform such tracking in a human-like fashion remains unclear, in part because existing evaluations rely on artificial tasks, far removed from...

Karolina Dro\.zd\.z, Micha Heilbron · 0 citations
#natural language process... Preprint Open access Sep 2026

Massive Activations in Hybrid Linear Attention Large Language Models: Pre-Attention Spikes and Inter-Spike Plateaus

We present the first systematic study of massive activations (MAs) in layer-interleaved Hybrid linear attention large language models (HLA LLMs), examining their architectural organization, training-time emergence, underlying mechanisms, and functional significance. Across five linear attention architectures, six hybri...

Zunhai Su, Bohan Sun, Xialie Zhuang et al. · 0 citations
#natural language process... Preprint Open access Sep 2026

Are We Measuring Strategy or Phrasing? The Gap Between Surface- and Approach-Level Diversity in LLM Math Reasoning

Diversity in LLM mathematical reasoning is critical for exploration, but common diversity metrics mostly capture surface-level variation rather than differences in how a problem is solved. We address this gap by introducing approach-level diversity: variation in strategies across correct solutions to the same problem....

Sangmook Lee, Minbeom Kim, Jeonghye Kim et al. · 0 citations
#natural language process... Preprint Open access Sep 2026

TriageRA-CCF: Source-Side Clinical Confidence and Coverage Signals for Adaptive Rank Budgeting in Medical LLMs

Medical large language models are commonly adapted with a fixed low-rank budget, even though medical questions differ substantially in confidence, clinical coverage, and cross-domain difficulty. We study adaptive rank budgeting for parameter-efficient medical question answering: for each question, the adapter decides w...

Shucan Ji, Yining Huang, Hongliang Guo · 0 citations
#natural language process... Preprint Open access Sep 2026

Evaluating Cross-lingual Knowledge Consistency in Code-Mixed vis-a-vis Indian Languages using IndicKLAR

Large language models often exhibit a substantial gap between their performance in English and in lower-resourced languages on equivalent knowledge queries---a cross-lingual consistency issue that remains underexplored for Indian languages and their code-mixed counterparts. To study this gap, we introduce IndicKLAR, an...

Debajyoti Mazumder, Divyansh Pathak, Prashant Kodali et al. · 0 citations

From tech blogs

See all →
MIT News · Artificial Intelligence Sep 24, 2026

Estimating suicide risk from text

A new language-processing tool could help identify the highest-risk individuals from natural language, enabling swifter interventions.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.