Skip to content

Category

natural language processing

7,546 papers

#natural language process... Preprint Open access Sep 2026

Bootstrapping Audiovisual Speech Recognition in Zero-AV-Resource Scenarios

Audiovisual speech recognition (AVSR) combines acoustic and visual cues to improve transcription robustness under challenging conditions but remains out of reach for most under-resourced languages due to the lack of labeled video corpora for training. Synthetic visual data have been shown to be an effective augmentatio...

Pol Buitrago, Javier Hernando · 0 citations
#natural language process... Preprint Jun 2026

Entity tracking emerges in sub-billion parameter language models and exceeds human performance in naturalistic narratives

This work evaluates entity tracking in both language models and humans using naturalistic narratives at multiple levels of complexity, finding that entity tracking degrades specifically with narrative complexity, not narrative length.

K. Drożdż, Micha Heilbron · 0 citations
#natural language process... Preprint Open access Sep 2026

Massive Activations in Hybrid Linear Attention Large Language Models: Pre-Attention Spikes and Inter-Spike Plateaus

We present the first systematic study of massive activations (MAs) in layer-interleaved Hybrid linear attention large language models (HLA LLMs), examining their architectural organization, training-time emergence, underlying mechanisms, and functional significance. Across five linear attention architectures, six hybri...

Zunhai Su, Bohan Sun, Xialie Zhuang et al. · 0 citations
#natural language process... Preprint Open access Sep 2026

Are We Measuring Strategy or Phrasing? The Gap Between Surface- and Approach-Level Diversity in LLM Math Reasoning

Diversity in LLM mathematical reasoning is critical for exploration, but common diversity metrics mostly capture surface-level variation rather than differences in how a problem is solved. We address this gap by introducing approach-level diversity: variation in strategies across correct solutions to the same problem....

Sangmook Lee, Minbeom Kim, Jeonghye Kim et al. · 0 citations
#natural language process... Preprint Open access Sep 2026

TriageRA-CCF: Source-Side Clinical Confidence and Coverage Signals for Adaptive Rank Budgeting in Medical LLMs

Medical large language models are commonly adapted with a fixed low-rank budget, even though medical questions differ substantially in confidence, clinical coverage, and cross-domain difficulty. We study adaptive rank budgeting for parameter-efficient medical question answering: for each question, the adapter decides w...

Shucan Ji, Yining Huang, Hongliang Guo · 0 citations

Evaluating Cross-lingual Knowledge Consistency in Code-Mixed vis-a-vis Indian Languages using IndicKLAR

IndicKLAR, an Indic extension of the KLAR-CLC benchmark covering 18 of the 22 scheduled Indian languages, is introduced and a consistent flip point is observed between the transition from incorrect to correct prediction---between the native and code-mixed settings.

Debajyoti Mazumder, Divyanshu Pathak, P. Kodali et al. · 0 citations
#natural language process... Preprint Open access Sep 2026

KSAFE-MM: A Multimodal Safety Benchmark via Localized Contextualization for Korean Cultural Risks

Multimodal Large Language Models (MLLMs) exacerbate safety risks by introducing vulnerabilities across multiple modalities, such as language and vision. Current MLLM safety evaluation tools, however, suffer from major limitations: 1) English-centric dataset construction, and 2) a focus on generic risks that are not tie...

Yongwoo Kim, Sojung An, Yunjin Park et al. · 0 citations
#natural language process... Preprint Open access Sep 2026

Think Multilingual, Not Harder: A Data-Efficient Framework for Teaching Reasoning Models to Code-Switch

Recent developments in reasoning capabilities have enabled large language models to solve increasingly complex mathematical, symbolic, and logical tasks. Interestingly, while reasoning models are often trained to generate monolingual text, these models have also been observed to code-switch (i.e., mix languages). Prior...

Eleanor M. Lin, David Jurgens · 0 citations
#natural language process... Preprint Open access Sep 2026

RAWR: Reward Assignment Without Rollouts in Verifiable Domains

Understanding and evaluating multi-step reasoning in LLMs at the level of individual steps remains a key challenge. Process reward models (PRMs) provide a solution by scoring each step, enabling fine-grained supervision and improved reliability. However, training them requires costly human annotation or computationally...

Corentin Royer (International Business Machines), Anna Hedstr\"om (ETH AI Center), Debarun Bhattacharjya (Lirio) et al. · 0 citations
#natural language process... Preprint Open access Sep 2026

SiDiaC-v.2.0: Sinhala Diachronic Corpus Version 2.0

SiDiaC-v.2.0 is the largest comprehensive Sinhala Diachronic Corpus to date, covering a period from 1800 CE to 1955 CE in terms of publication dates, and a historical span from the 5th to the 20th century CE in terms of written dates. The corpus consists of 229k words across 185 literary works that underwent thorough f...

Nevidu Jayatilleke, Nisansa de Silva, Uthpala Nimanthi et al. · 0 citations

Evaluating Alignment of Behavioral Dispositions in LLMs

This work introduces STAR, a framework for studying how closely the dispositions expressed by LLMs align with those of humans, and finds that LLM recommendations are substantially less diverse than human choices, both within individual models and even across models from different providers.

Amir Taubenfeld, Zorik Gekhman, Lior Nezry et al. · 7 citations
#natural language process... Preprint Open access Sep 2026

IESR:Efficient MCTS-Based Modular Reasoning for Text-to-SQL with Large Language Models

Text-to-SQL is a key natural language processing task that maps natural language questions to SQL queries, enabling intuitive interaction with web-based databases. Although current methods perform well on benchmarks like BIRD and Spider, they struggle with complex reasoning, domain knowledge, and hypothetical queries,...

Tao Liu, Jiafan Lu, Bohan Yu et al. · 0 citations

From tech blogs

See all →
MIT News · Artificial Intelligence Oct 15, 2026

AI model decodes the language cells use to communicate

A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.

Microsoft Research Blog Oct 15, 2026

Proof-based general-purpose computing with Magnetar

Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.

MIT News · Artificial Intelligence Sep 24, 2026

Estimating suicide risk from text

A new language-processing tool could help identify the highest-risk individuals from natural language, enabling swifter interventions.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.