Skip to content

Category

natural language processing

6,756 papers

#artificial intelligence Preprint May 2026

LSR-Ben: A Logical and Scientific Reasoning Benchmark for Evaluating Process Reward Models

LSR-Ben is introduced, a process-level benchmark specifically designed for assessing PRM's performance across two primary reasoning domains (scientific and logical reasoning) and nine subdomains and it is hoped LSR-Ben can foster future researches on PRMs for broader domains, thereby enhancing the reasoning capabilitie...

Zhouhao Sun, Xuan Zhang, Xiaofeng Ding et al. · 0 citations
#artificial intelligence Preprint Nov 2025

Superficial Reflection or Genuine Thought? A Fine-Grained Cognitive Analysis of Large Reasoning Models

Motivated by the observed human-like behaviours in Large Reasoning Models (LRMs), this paper introduces a comprehensive taxonomy to characterise atomic reasoning steps and analyse the reasoning behaviours of LRMs. Grounded in human cognitive processes, we propose a taxonomy comprising five groups and seventeen categori...

Yu-Xiang Chen, Zuohan Wu, Ziwei Wang et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Semifactual Credit-Augmented Policy Optimization

Reinforcement learning with verifiable rewards (RLVR) has improved the reasoning capabilities of large language models (LLMs), yet their predictions remain sensitive to task-irrelevant prompt features. We investigate this sensitivity through semifactual prompt interventions that preserve the underlying problem and its...

Jun-Shu Pan, Zhi-Zhang Fu, Shu-Lin Huang et al. · 0 citations
#artificial intelligence Review Sep 2026

MatLoom: Layered Text-to-Material Generation in a Compact Program Space

Material generation should produce not only an appearance, but also the rules that construct it. We introduce MatLoom, a compact, layer-oriented language for text-to-material generation with pretrained language models. Each program composes alpha-masked layers whose shared spatial expressions define coverage and physic...

Anson Y. Lam, Shu-Qing Li, M. Lyu · 0 citations
#artificial intelligence Preprint Sep 2026

Scaling Laws for Looped Mixture of Experts

Looped transformers and Mixture-of-Experts (MoE) offer complementary routes to efficient scaling: recurrence increases computational depth at fixed parameters, while MoE sparsity expands total capacity at fixed active compute. Yet existing scaling laws model recurrence or sparsity in isolation. In this work, we introdu...

Yan-Bei Chen, Anirudh Goyal, Raghuraman Krishnamoorthi · 0 citations
#artificial intelligence Preprint Sep 2026

Linguistic Loopholes in LLM Unlearning: From a 174-Language Benchmark to Coverage-Aware Unlearning

Unlearning a fact in one language does not guarantee its removal in others as changing the query or even the requested answer language can reopen seemingly forgotten knowledge -- a cross-lingual loophole. The most straightforward solution to this challenge -- unlearning in all languages -- is neither scalable nor desir...

Tyler Skow, Shravan Chaudhari, Ramalingam Chellappa et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

cua-speedrun: Standardized Benchmarking of the Speed of Computer-Use Agents

Computer use agents (CUAs), which use graphical user interfaces (GUIs) to complete tasks on a computer, have recently surpassed human performance on many standard benchmarks, including difficult long-horizon tasks. Their capabilities are undoubtedly impressive, however, a key barrier to the widespread adoption and depl...

Pranjal Aggarwal, Lawrence Keunho Jang, Sean Welleck et al. · 0 citations
#artificial intelligence Preprint Sep 2026

PhantomEnvironments: Training LLM Agents in Fictional Worlds

Training LLM agents with reinforcement learning (RL) is bottlenecked by environments, which must provide verifiable rewards, support long-horizon interaction, and scale cheaply. Existing approaches rely on costly human-curated data or on LLM-generated environments that risk hallucinations and benchmark contamination. W...

Anmol Kabra, Swathi Saravana Selvam, Albert Gong et al. · 0 citations
#artificial intelligence Preprint Sep 2026

SCB: SpeechConversationBench for Evaluating Multi-Turn Reasoning in Speech-to-Speech Models

Speech-to-speech systems must solve tasks whose requirements emerge across conversational turns. We introduce SpeechConversationBench (SCB), a focused evaluation of spoken mathematical reasoning using 103 sharded GSM8K problems. The framework compares the original problem delivered in one turn (full), its concatenated...

Kanpat Vesessook, Saksorn Ruangtanusak · 0 citations
#artificial intelligence Preprint Sep 2026

MemLife: Curating and Reasoning over Long-Term Egocentric Video Memories

Long-term egocentric video enables personalized AI assistants to reason about daily life. However, as video histories grow to hundreds of hours spanning months or years, reprocessing raw clips for every query becomes computationally prohibitive. Memory systems offer a scalable alternative by compacting videos into text...

Guang-Zhi Xiong, Xin-Yuan Zhang, Xiao Yang et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

On the (In)effectiveness of AMR Augmentation for Large Language Models

While Abstract Meaning Representation (AMR) has historically improved performance on a range of NLP tasks, the benefit---or lack thereof---of AMR augmentation for modern LLMs is thus far unclear. In this paper, we attempt to reproduce recent work that reported substantial downstream gains from AMR augmentation, finding...

Hoa Quynh Nhung Nguyen, Jacopo Staiano, Michael Sullivan · 0 citations
#artificial intelligence Preprint Sep 2026

Mid-Harness: Scaling Actions Between Model and Harness for Terminal Agents

Terminal agents act through stochastic model generations, yet the ability to generate a useful action does not ensure its reliable execution. A poor command (e.g., wrong package install) can change the environment in ways that hinder subsequent progress, even when the model could generate a better alternative. We inves...

Minki Kang, Ryo Hachiuma, Shao-Kun Zhang et al. · 1 citation

From tech blogs

See all →
MIT News · Artificial Intelligence Sep 24, 2026

Estimating suicide risk from text

A new language-processing tool could help identify the highest-risk individuals from natural language, enabling swifter interventions.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.