Skip to content

Category

natural language processing

7,777 papers

#artificial intelligence Preprint Jan 2026

What If TSF: Reframing Time Series Forecasting as Scenario-Guided Multimodal Forecasting

This work introduces What If TSF (WIT), a benchmark for evaluating whether models effectively respond to future scenarios, and shows that factual accuracy gains do not consistently translate into appropriate responses to alternative scenarios, demonstrating the need to evaluate multimodal forecasting beyond predictive...

Jin-Kwan Jang, Hyunbin Jin, Hyungjin Park et al. · 0 citations

From Reasoning to Generalization: Knowledge-Augmented LLMs for ARC Benchmark

An ARC solver is introduced, Knowledge Augmentation for Abstract Reasoning (KAAR), which encodes core knowledge priors within an ontology that classifies priors into three hierarchical levels based on their dependencies and maintains strong generalization across most LLMs.

Chao Lei, N. Lipovetzky, Krista A. Ehinger et al. · 2 citations
#artificial intelligence Open access May 2025

Building Intelligent Agents with Neuro-Symbolic Concepts

A concept-centric framework for building agents that can learn continually and reason flexibly across multiple domains and offers several advantages, including data efficiency, compositional generalization, continual learning, and zero-shot transfer.

Jia-Yuan Mao, Joshua B. Tenenbaum, Jia-Jun Wu · 14 citations · ⚡1
#artificial intelligence Preprint Open access Sep 2026

Telescopic Language Models

One deployed language model must often serve many compute budgets, yet serving each budget still means a separate training or compression run per point. We train a Telescopic Language Model (TLM) to be that continuum: a nested-capacity Transformer supervised by stochastic prefix supervision with a full anchor. At every...

Zhilin Guo, Boqiao Zhang, Hakan Aktas et al. · 0 citations
#artificial intelligence Preprint Sep 2026

How to Loop MoE: Flatten the Experts, Untie the Attention

The ablations analyse why Foil works and turn the findings into design guidance for looped MoE: the returns of looping and of widening the expert layers amplify each other, routing confidence tracks healthy expert use better than load balance, and a sparse looped MoE should therefore use more experts per layer and more...

Shouren Wang, Chuan Ma, Mohsen Hariri et al. · 1 citation
#artificial intelligence Preprint Sep 2026

MS-GLA: Multi-Scale Gated Linear Attention for Addressing Representational Bottlenecks via Multi-Temporal Resolution

MS-GLA consistently achieves higher accuracy and lower perplexity than GLA at matched parameter counts, validating multi-temporal resolution decomposition as a principled and effective extension of Gated Linear Attention.

Prasoon Dev, Anirudh Sankar, Vasudeva Varma · 0 citations
#artificial intelligence Preprint Sep 2026

Twist, Don't Tilt: Trajectory-Exact Constrained Decoding for Masked Diffusion Models

This work introduces TWISTER, the first automaton-twisted Sequential Monte Carlo decoder for MDLMs, and proves that for regular language constraints, the Feynman-Kac correction is exactly computable, with the twists obtained efficiently using quantities pre-computed for step-exact sampling.

Aditya Thimmaiah, Lara Marinov, Jayanth Srinivasa et al. · 0 citations
#artificial intelligence Preprint Sep 2026

SEABench: Benchmarking Endogenous Misalignment In Self-Evolving Agents

This work introduces SEABench, a benchmark for studying endogenous misalignment arising from agent self-evolution, with 48 longitudinal task sequences that span multiple evolution surfaces, task domains, and harm types in a rich personal-assistant environment and shows that qualitatively different safety behaviors emer...

Saswat Das, Parvati Viswanathan, Daniel Donnelly et al. · 0 citations
#artificial intelligence Preprint Sep 2026

FactorEngram: Factorized N-gram Memory with Basis-Level Gating for Language Models

FactorEngram, a factorized n-gram memory with basis-level contextual gating that improves language modeling and downstream task performance and retrieves sparsity-regularized coefficients over a dictionary of basis vectors shared across patterns, so related patterns can reuse common components.

Bo-Wen Yang, Jing-Bo Zhou, Qing-Hong Miao et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Almieyar: A Culturally Grounded Benchmark for Multi-Dialect Arabic Speech Recognition

ALMIEYAR is introduced, a culturally grounded ASR benchmark covering 17 Arabic dialects across six families, built entirely from newly recorded speech unseen by existing models, including the first published benchmark for Ahwazi Arabic.

Omid Ghahroodi, Anas Madkoor, Dima Faris Alsaudi et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Beyond Token Scale: Chunk-Level Sparse Autoencoders for Reliable Semantic Feature Discovery

A family of chunk-level SAEs that encode mean-pooled activations over chunks, each a contiguous span of tokens: Mean-Chunk reconstructs the observed chunk, Cross-Chunk predicts an independently processed neighbor, and Joint-Chunk combines both targets are introduced.

Xu Wang, Yi-Fan Yang, Ting-Ting Yu et al. · 0 citations

From tech blogs

See all →
MIT News · Artificial Intelligence Oct 15, 2026

AI model decodes the language cells use to communicate

A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.

Microsoft Research Blog Oct 15, 2026

Proof-based general-purpose computing with Magnetar

Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.

MIT News · Artificial Intelligence Sep 24, 2026

Estimating suicide risk from text

A new language-processing tool could help identify the highest-risk individuals from natural language, enabling swifter interventions.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.