Skip to content

Category

natural language processing

8,786 papers

#artificial intelligence Preprint Sep 2026

MS-GLA: Multi-Scale Gated Linear Attention for Addressing Representational Bottlenecks via Multi-Temporal Resolution

MS-GLA consistently achieves higher accuracy and lower perplexity than GLA at matched parameter counts, validating multi-temporal resolution decomposition as a principled and effective extension of Gated Linear Attention.

Prasoon Dev, Anirudh Sankar, Vasudeva Varma · 0 citations
#artificial intelligence Preprint Sep 2026

Twist, Don't Tilt: Trajectory-Exact Constrained Decoding for Masked Diffusion Models

This work introduces TWISTER, the first automaton-twisted Sequential Monte Carlo decoder for MDLMs, and proves that for regular language constraints, the Feynman-Kac correction is exactly computable, with the twists obtained efficiently using quantities pre-computed for step-exact sampling.

Aditya Thimmaiah, Lara Marinov, Jayanth Srinivasa et al. · 0 citations
#artificial intelligence Preprint Sep 2026

SEABench: Benchmarking Endogenous Misalignment In Self-Evolving Agents

This work introduces SEABench, a benchmark for studying endogenous misalignment arising from agent self-evolution, with 48 longitudinal task sequences that span multiple evolution surfaces, task domains, and harm types in a rich personal-assistant environment and shows that qualitatively different safety behaviors emer...

Saswat Das, Parvati Viswanathan, Daniel Donnelly et al. · 1 citation
#artificial intelligence Preprint Sep 2026

FactorEngram: Factorized N-gram Memory with Basis-Level Gating for Language Models

FactorEngram, a factorized n-gram memory with basis-level contextual gating that improves language modeling and downstream task performance and retrieves sparsity-regularized coefficients over a dictionary of basis vectors shared across patterns, so related patterns can reuse common components.

Bo-Wen Yang, Jing-Bo Zhou, Qing-Hong Miao et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Almieyar: A Culturally Grounded Benchmark for Multi-Dialect Arabic Speech Recognition

ALMIEYAR is introduced, a culturally grounded ASR benchmark covering 17 Arabic dialects across six families, built entirely from newly recorded speech unseen by existing models, including the first published benchmark for Ahwazi Arabic.

Omid Ghahroodi, Anas Madkoor, Dima Faris Alsaudi et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Beyond Token Scale: Chunk-Level Sparse Autoencoders for Reliable Semantic Feature Discovery

A family of chunk-level SAEs that encode mean-pooled activations over chunks, each a contiguous span of tokens: Mean-Chunk reconstructs the observed chunk, Cross-Chunk predicts an independently processed neighbor, and Joint-Chunk combines both targets are introduced.

Xu Wang, Yi-Fan Yang, Ting-Ting Yu et al. · 0 citations
#artificial intelligence Preprint Sep 2026

CLIMB: A Clinical Multimorbidity Benchmark for Diagnosing Co-occurring Conditions through Multiturn Conversations

CLIMB is introduced, a benchmark in which a doctor model interviews a simulated patient to recover a ground truth set of co-occurring clinical conditions, and a theoretical reference model of single-hypothesis tracking is formalised with a theoretical reference model of single-hypothesis tracking.

Yusuf Kesmen, A. Mukherjee, Ye-Na Chang et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Frontier Learning: Training LLM Reasoners at the Edge of Capability

Across several reasoning tasks and model families, the proposed frontier learning approach consistently achieves higher relative gains over fixed-pool baselines, demonstrating that effective post-training requires not only selecting useful problems, but continually generating them at the edge of capability.

Robin Faro, S. Ramesh, Ilija Bogunovic et al. · 0 citations
#artificial intelligence Book Open access Sep 2026

Semantic Prefix Oracles for LLM Decoding: Contracts and Differential Validation

Constrained decoding can enforce regular or context-free output formats, but many program-generation failures are semantic: scope, typing, and declaration effects depend on context. We present semantic grammar specifications, a declarative formalism that attaches such constraints to a context-free surface and executes...

Paul Kronlund-Drouault · 0 citations
#artificial intelligence Conference Open access Sep 2026

AwarenessBench: Assessing Cognitive Capabilities of Language Models

This work introduces AwarenessBench, the first comprehensive benchmark for assessing the cognitive abilities of LMs in four dimensions: metacognition, self-awareness, social awareness, and situational awareness, covering 15 cognitive functions and 14,381 samples.

Xiaojian Li, Rongwu Xu, Tianyun Zhang et al. · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

MIT News · Artificial Intelligence Oct 15, 2026

AI model decodes the language cells use to communicate

A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.

Microsoft Research Blog Oct 15, 2026

Proof-based general-purpose computing with Magnetar

Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.

MIT News · Artificial Intelligence Sep 24, 2026

Estimating suicide risk from text

A new language-processing tool could help identify the highest-risk individuals from natural language, enabling swifter interventions.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.