Skip to content

Category

natural language processing

7,775 papers

#artificial intelligence Preprint Sep 2026

Reach Into The CHOIR: Free-List Elicitation Uncovers Distinct Model Voices in LLM Ensembles

Open-ended LLM homogeneity can create false plurality when several systems appear to offer independent perspectives while returning the same familiar default. Single-pass answers obscure the distinction between agreement produced by a tightly constrained answer space, prompt-vocabulary echo, and broader answer spaces w...

Ben Wigler, M. Tsfasman · 0 citations
#artificial intelligence Preprint Sep 2026

ArgGYM: A Procedural, Engine-Verified Benchmark for Structured Defeasible Reasoning

Recent progress in large language model reasoning has been driven by benchmarks and reinforcement learning environments with automatically verifiable rewards, particularly in mathematics, code, and formal logic. These settings make model accuracy easier to evaluate and optimize, but it remains unclear how far success u...

Ibrahim Ethem Deveci, Funda Tan Çalık, Barış Deniz Sağlam et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Fine-Tuning Diffusion Language Models with Context Selection and Target Weighting

GoldiMask is introduced, which selects tokens to reveal as context by approximately maximizing a submodular objective and weights the remaining targets according to how they benefit from the selected context and their remaining learning potential.

L. Mualem, L. Pastor-Pérez, Vinh Tong et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Beyond Mode Collapse: Generating Diverse Synthetic Expert Conversations via Generative Flow Networks

This work shows that training GFlowNets to generate latent conversation structure using a Gaussian mixture density over key interaction features enables sampling expert strategies in proportion to their prevalence in the training data to provide a stronger training signal than competitive synthesis baselines.

Sumit Asthana, Michael Ion, Kevyn Collins Thompson · 0 citations
#natural language process... Preprint Open access Sep 2026

HPRO: Hierarchical Progressive Reward Optimization via Preference Extraction for Emotional Text-to-Speech

Recently, Large Language Model (LLM)-based Text-to-Speech (TTS) models have achieved remarkable naturalness. However, the standard Supervised Fine-Tuning paradigm often converges to statistically averaged prosody, limiting emotional expressiveness. While preference-driven optimization offers a promising alternative, ex...

Sihang Nie, Xiaofen Xing, Rui Xing et al. · 0 citations
#natural language process... Preprint Open access Sep 2026

CORE-BREW: LLR-Based Soft Decoding for Robust Multi-Bit LLM Watermarking

Reliable provenance for LLM outputs requires multi-bit watermarks that remain robust under editing while maintaining low false-positive rates. Existing ECC-based LLM watermarks rely on hard-decision decoding, discarding token-level reliability information and limiting robustness under post-generation edits. We propose...

Joeun Kim, HoEun Kim, Young-Sik Kim · 0 citations
#natural language process... Preprint Open access Sep 2026

Remember Your Trace: Memory-Guided Long-Horizon Agentic Framework for Consistent and Hierarchical Repository-Level Code Documentation

Automated code documentation is essential for modern software development, providing the contextual grounding that both human developers and coding agents rely on to navigate large codebases. Existing repository-level approaches process components independently, causing redundant retrieval and conflicting descriptions...

Suyoung Bae, Jaehoon Lee, Changkyu Choi et al. · 0 citations
#natural language process... Preprint Open access Sep 2026

Bootstrapping Audiovisual Speech Recognition in Zero-AV-Resource Scenarios

Audiovisual speech recognition (AVSR) combines acoustic and visual cues to improve transcription robustness under challenging conditions but remains out of reach for most under-resourced languages due to the lack of labeled video corpora for training. Synthetic visual data have been shown to be an effective augmentatio...

Pol Buitrago, Javier Hernando · 0 citations
#natural language process... Preprint Jun 2026

Entity tracking emerges in sub-billion parameter language models and exceeds human performance in naturalistic narratives

This work evaluates entity tracking in both language models and humans using naturalistic narratives at multiple levels of complexity, finding that entity tracking degrades specifically with narrative complexity, not narrative length.

K. Drożdż, Micha Heilbron · 0 citations
#natural language process... Preprint Open access Sep 2026

Massive Activations in Hybrid Linear Attention Large Language Models: Pre-Attention Spikes and Inter-Spike Plateaus

We present the first systematic study of massive activations (MAs) in layer-interleaved Hybrid linear attention large language models (HLA LLMs), examining their architectural organization, training-time emergence, underlying mechanisms, and functional significance. Across five linear attention architectures, six hybri...

Zunhai Su, Bohan Sun, Xialie Zhuang et al. · 0 citations
#natural language process... Preprint Open access Sep 2026

Are We Measuring Strategy or Phrasing? The Gap Between Surface- and Approach-Level Diversity in LLM Math Reasoning

Diversity in LLM mathematical reasoning is critical for exploration, but common diversity metrics mostly capture surface-level variation rather than differences in how a problem is solved. We address this gap by introducing approach-level diversity: variation in strategies across correct solutions to the same problem....

Sangmook Lee, Minbeom Kim, Jeonghye Kim et al. · 0 citations
#natural language process... Preprint Open access Sep 2026

TriageRA-CCF: Source-Side Clinical Confidence and Coverage Signals for Adaptive Rank Budgeting in Medical LLMs

Medical large language models are commonly adapted with a fixed low-rank budget, even though medical questions differ substantially in confidence, clinical coverage, and cross-domain difficulty. We study adaptive rank budgeting for parameter-efficient medical question answering: for each question, the adapter decides w...

Shucan Ji, Yining Huang, Hongliang Guo · 0 citations

From tech blogs

See all →
MIT News · Artificial Intelligence Oct 15, 2026

AI model decodes the language cells use to communicate

A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.

Microsoft Research Blog Oct 15, 2026

Proof-based general-purpose computing with Magnetar

Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.

MIT News · Artificial Intelligence Sep 24, 2026

Estimating suicide risk from text

A new language-processing tool could help identify the highest-risk individuals from natural language, enabling swifter interventions.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.