Skip to content

Category

natural language processing

7,777 papers

#artificial intelligence Preprint Jun 2026

Cliff Tokens: Analyzing Failure Trigger Tokens in LLM Mathematical Reasoning

This work introduces the cliff token, a token at which the estimated probability of reaching the correct answer (success probability) drops beyond an adaptive threshold, and introduces a cliff taxonomy of deterministic, uncertain, and sampled-off cliffs, defined by greedy choice and token entropy.

J. Ko, Jinu Lee, Pilsung Kang et al. · 0 citations

AgentCL: Toward Rigorous Evaluation of Continual Learning in Language Agents

An evaluation framework AgentCL for continual learning in agents is presented, centered on distinguishable task streams and metrics for CL properties, and MemProbe is developed, a probing method that stores interactions, insights, and skills while filtering unreliable experiences during consolidation.

Yiheng Shu, Bernal Jiménez Gutiérrez, Saisri Padmaja Jonnalagedda et al. · 8 citations
#artificial intelligence Preprint Open access Sep 2026

Context Pruning for Coding Agents via Multi-Rubric Latent Reasoning

LLM-powered coding agents spend the majority of their token budget reading repository files, yet much of the retrieved code is irrelevant to the task at hand. Existing learned pruners compress this context with a single-objective sequence labeler, collapsing all facets of code relevance into one score and one transitio...

Jingjing Wang, Xiwen Chen, Wenhui Zhu et al. · 0 citations
#artificial intelligence Preprint May 2026

How Deep Can LLMs Learn to Reason? Expressiveness Is Key

ScaleLogic is introduced, a synthetic logical reasoning framework that offers independent control over two axes of difficulty: the depth of the required proof planning and the expressiveness of the underlying formal system.

Tianle Wang, Zhaoyang Wang, Guangchen Lan et al. · 1 citation
#artificial intelligence Preprint May 2026

Hindsight Compacts but Does Not Repair: Rethinking On-Policy Self-Distillation in Reasoning Models

It is hypothesized that in long traces, hindsight reveals which steps were unnecessary more readily than which steps would have repaired the solution, and that changing the divergence, enriching or reinjecting the privileged context, and training longer only move OPSD along the same accuracy-length tradeoff.

Jaehoon Kim, Dong-Ha Lee · 4 citations

BALAR : A Bayesian Agentic Loop for Active Reasoning

BALAR (Bayesian Agentic Loop for Active Reasoning), a task-agnostic outer-loop algorithm that requires no fine-tuning and enables multi-turn interaction between an LLM agent and a user, is proposed.

Aymen Echarghaoui, Dong-Xia Wu, Emily B. Fox · 1 citation

Acceptance Dynamics Across Cognitive Domains in Speculative Decoding

It is found that task type is a stronger predictor of acceptance than tree depth, and chat produces the highest entropy yet the highest acceptance rate, which has direct implications for domain-aware speculation budgets and draft-model selection strategies.

Saifeddine Mahmoud · 1 citation

MMORF: A Multi-agent Framework for Designing Multi-objective Retrosynthesis Planning Systems

MMORF is presented, a framework for constructing language model-based multi-agent systems (MAS) for multi-objective retrosynthesis planning that achieves strong safety and cost metrics on soft-constraint tasks, frequently Pareto-dominating baseline routes, and outperforming state-of-the-art baselines.

Frazier N. Baker, Trieu Nguyen, Reza Averly et al. · 1 citation
#artificial intelligence Preprint Open access Sep 2026

MASRubric: Auditing Information Flow in Multi-Agent Systems with Failure-Distilled Pitfall Rubrics

While multi-agent systems (MAS) excel at complex reasoning, they are vulnerable to errors that intermediate agents introduce and downstream agents build upon. Auditing intermediate messages before they propagate requires an explicit standard, yet evaluation rubrics are typically authored by domain experts or written ag...

Yutong Wang, Siyuan Xiong, Xuebo Liu et al. · 0 citations
#artificial intelligence Preprint Open access Sep 2026

TSR: Trajectory-Search Rollouts for Multi-Turn RL of LLM Agents

Advances in large language models (LLMs) are driving a shift toward using reinforcement learning (RL) to train agents from iterative, multi-turn interactions across tasks. However, multi-turn RL remains challenging as rewards are often sparse or delayed, and environments can be stochastic. In this regime, naive traject...

Aladin Djuhera, Swanand Kadhe, Farhan Ahmed et al. · 0 citations
#artificial intelligence Preprint Open access Sep 2026

Latent Chain-of-Thought as Planning: Decoupling Reasoning from Verbalization

Chain-of-Thought (CoT) empowers Large Language Models (LLMs) to tackle complex problems, but remains constrained by the computational cost and early token commitments in discrete reasoning traces. Recent latent reasoning approaches attempt to optimize efficiency by performing reasoning within continuous hidden states....

Jiecong Wang, Hao Peng, Zhanyi Wang et al. · 0 citations

From tech blogs

See all →
MIT News · Artificial Intelligence Oct 15, 2026

AI model decodes the language cells use to communicate

A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.

Microsoft Research Blog Oct 15, 2026

Proof-based general-purpose computing with Magnetar

Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.

MIT News · Artificial Intelligence Sep 24, 2026

Estimating suicide risk from text

A new language-processing tool could help identify the highest-risk individuals from natural language, enabling swifter interventions.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.