Skip to content

Category

natural language processing

7,304 papers

#artificial intelligence Preprint Open access Oct 2026

ETHER: Aligning Emergent Communication for Hindsight Experience Replay

Hindsight Experience Replay (HER) enhances sample efficiency in goal-conditioned reinforcement learning (RL) by relabelling failed trajectories with goals that were actually achieved. However, HER assumes access to a goal relabelling function and a predicate function that determines whether a goal has been satisfied. T...

Kevin Yandoka Denamgana\"i, Daniel Hernandez, Ozan Vardal et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

CombEval: A Framework for Evaluating Combinatorial Counting in Large Language Models

We present CombEval, a dynamic benchmark for evaluating combinatorial counting in large language models. CombEval represents each problem as a typed Cofola specification over entities, combinatorial objects, object dependencies, and constraints, enabling controlled generation of natural-language counting problems with...

Yuxu Zhou, Ond\v{r}ej Ku\v{z}elka, Yuyi Wang et al. · 0 citations
#artificial intelligence Preprint May 2026

Generalizing the Turing Test to Interactive Agents

The study of the Generalized Turing Test is initiated, a formal generalization of Turing's imitation game from humans to arbitrary interactive agents, yielding an inherently adaptive form of evaluation that does not rely on fixed benchmarks.

Daniel Mitropolsky, Riccardo Neumarker, Emanuele Rimoldi et al. · 0 citations
#artificial intelligence Preprint May 2026

LSR-Ben: A Logical and Scientific Reasoning Benchmark for Evaluating Process Reward Models

LSR-Ben is introduced, a process-level benchmark specifically designed for assessing PRM's performance across two primary reasoning domains (scientific and logical reasoning) and nine subdomains and it is hoped LSR-Ben can foster future researches on PRMs for broader domains, thereby enhancing the reasoning capabilitie...

Zhouhao Sun, Xuan Zhang, Xiaofeng Ding et al. · 0 citations
#artificial intelligence Preprint Nov 2025

Superficial Reflection or Genuine Thought? A Fine-Grained Cognitive Analysis of Large Reasoning Models

Motivated by the observed human-like behaviours in Large Reasoning Models (LRMs), this paper introduces a comprehensive taxonomy to characterise atomic reasoning steps and analyse the reasoning behaviours of LRMs. Grounded in human cognitive processes, we propose a taxonomy comprising five groups and seventeen categori...

Yu-Xiang Chen, Zuohan Wu, Ziwei Wang et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Semifactual Credit-Augmented Policy Optimization

Reinforcement learning with verifiable rewards (RLVR) has improved the reasoning capabilities of large language models (LLMs), yet their predictions remain sensitive to task-irrelevant prompt features. We investigate this sensitivity through semifactual prompt interventions that preserve the underlying problem and its...

Jun-Shu Pan, Zhi-Zhang Fu, Shu-Lin Huang et al. · 0 citations
#artificial intelligence Review Sep 2026

MatLoom: Layered Text-to-Material Generation in a Compact Program Space

Material generation should produce not only an appearance, but also the rules that construct it. We introduce MatLoom, a compact, layer-oriented language for text-to-material generation with pretrained language models. Each program composes alpha-masked layers whose shared spatial expressions define coverage and physic...

Anson Y. Lam, Shu-Qing Li, M. Lyu · 0 citations
#artificial intelligence Preprint Sep 2026

Scaling Laws for Looped Mixture of Experts

Looped transformers and Mixture-of-Experts (MoE) offer complementary routes to efficient scaling: recurrence increases computational depth at fixed parameters, while MoE sparsity expands total capacity at fixed active compute. Yet existing scaling laws model recurrence or sparsity in isolation. In this work, we introdu...

Yan-Bei Chen, Anirudh Goyal, Raghuraman Krishnamoorthi · 0 citations
#artificial intelligence Preprint Sep 2026

Linguistic Loopholes in LLM Unlearning: From a 174-Language Benchmark to Coverage-Aware Unlearning

Unlearning a fact in one language does not guarantee its removal in others as changing the query or even the requested answer language can reopen seemingly forgotten knowledge -- a cross-lingual loophole. The most straightforward solution to this challenge -- unlearning in all languages -- is neither scalable nor desir...

Tyler Skow, Shravan Chaudhari, Ramalingam Chellappa et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

cua-speedrun: Standardized Benchmarking of the Speed of Computer-Use Agents

Computer use agents (CUAs), which use graphical user interfaces (GUIs) to complete tasks on a computer, have recently surpassed human performance on many standard benchmarks, including difficult long-horizon tasks. Their capabilities are undoubtedly impressive, however, a key barrier to the widespread adoption and depl...

Pranjal Aggarwal, Lawrence Keunho Jang, Sean Welleck et al. · 0 citations
#artificial intelligence Preprint Sep 2026

PhantomEnvironments: Training LLM Agents in Fictional Worlds

Training LLM agents with reinforcement learning (RL) is bottlenecked by environments, which must provide verifiable rewards, support long-horizon interaction, and scale cheaply. Existing approaches rely on costly human-curated data or on LLM-generated environments that risk hallucinations and benchmark contamination. W...

Anmol Kabra, Swathi Saravana Selvam, Albert Gong et al. · 0 citations
#artificial intelligence Preprint Sep 2026

SCB: SpeechConversationBench for Evaluating Multi-Turn Reasoning in Speech-to-Speech Models

Speech-to-speech systems must solve tasks whose requirements emerge across conversational turns. We introduce SpeechConversationBench (SCB), a focused evaluation of spoken mathematical reasoning using 103 sharded GSM8K problems. The framework compares the original problem delivered in one turn (full), its concatenated...

Kanpat Vesessook, Saksorn Ruangtanusak · 0 citations

From tech blogs

See all →
MIT News · Artificial Intelligence Sep 24, 2026

Estimating suicide risk from text

A new language-processing tool could help identify the highest-risk individuals from natural language, enabling swifter interventions.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.