Skip to content

Category

natural language processing

6,756 papers

#artificial intelligence Preprint Jun 2026

Does Anthropomorphic Language Impact Public Perceptions of AI?

The results indicate that any immediate effects on opinions of AI are modest, although they leave open the possibility that anthropomorphic language could have an effect in naturalistic settings, or over gradual, continued exposure.

Betty Li Hou, Sophie Hao, Sunoo Park et al. · 0 citations
#artificial intelligence Review Jun 2026

Is Agent Code Less Maintainable Than Human Code?

It is found that agents are less effective at resolving tasks when building on agent code compared to human code, with task resolve rate drops of up to 13.1%.

Shaswat Patel, Betty Hou, A. Purohit et al. · 1 citation

Reproducing, Analyzing, and Detecting Reward Hacking in Rubric-Based Reinforcement Learning

CHERRL is introduced, a Controllable Hacking Environment for Rubric-based RL that enables stable reproduction of reward hacking, explicit observation of reward divergence, and identification of hacking onset and analyzes different judge biases from the perspectives of discoverability and exploitability.

Xuekang Wang, Zhuoyuan Hao, Shuo Hou et al. · 10 citations · ⚡1

Reasoning with Sampling: Cutting at Decision Points

An algorithm is introduced that uses the base model's next-token entropy as a proxy to identify key decision points and resample from those positions and it is proved that the method's mixing time scales with the number of decisions in a trace rather than with the number of tokens, which can be much larger.

Felix Zhou, Anay Mehrotra, Quanquan C. Liu · 3 citations
#artificial intelligence Preprint May 2026

Do Proactive Agents Need an LLM to Decide When to Act?

This work introduces a temporal-graph-learning (TGL) controller that learns these predictions jointly and supplies both outputs in one forward pass, and shows that a small graph model can handle both decisions and improve the language agents it controls.

Xiaoze Liu, Ruowang Zhang, Amir H. Abdi et al. · 2 citations

Decomposing and Measuring Evaluation Awareness

The framework and EvalAwareBench provide the tools to measure, attribute, and mitigate evaluation awareness, building the foundation for future solutions to ground evaluation awareness in social psychology.

Changling Li, Terry Jingchen Zhang, Jie M. Zhang et al. · 1 citation
#artificial intelligence Preprint Open access Sep 2026

PowerStep: Memory-Efficient Adaptive Optimization via $\ell_p$-Norm Steepest Descent

Adaptive optimizers such as Adam are standard for training Transformers, but storing gradient first and second moments incurs substantial memory overhead. We introduce PowerStep, a memory-efficient optimizer that achieves coordinate-wise adaptivity without storing second-moment statistics. Motivated by $\ell_p$-norm st...

Yao Lu, Dengdong Fan, Shixun Zhang et al. · 0 citations

GRAVITY: Architecture-Agnostic Structured Anchoring for Long-Horizon Conversational Memory

GRAVITY (Generation-time Relational Anchoring Via Injected Topological MemorY), a host-independent auxiliary memory layer, is introduced and shows that generation-time structure is a portable complement to existing memory retrieval, while its interaction with host evidence depends on the benchmark and host.

Yu-Shi Sun, Bo-Wen Cao, Dong Fang et al. · 2 citations

Revisiting the Capacity Gap in Chain-of-Thought Distillation from a Practical Perspective

Chain-of-thought (CoT) distillation transfers reasoning behaviors from a strong teacher to a smaller student, but prior work reports a capacity gap: distillation may fail when the teacher-student capability mismatch is large. We revisit the capacity gap from a practical perspective by re-examining commonly used experim...

T. Kajitsuka, Ukyo Honda, Sho Takase · 2 citations

Screening Is Enough

Screening is introduced, whose explicit threshold transforms bounded query--key similarities into relevance values, enabling exact rejection, empty selection, and direct inspection on a common scale, in a controlled comparison of 12 attention mechanisms on a matched Transformer backbone.

K. Nakanishi · 1 citation · ⚡1

From tech blogs

See all →
MIT News · Artificial Intelligence Sep 24, 2026

Estimating suicide risk from text

A new language-processing tool could help identify the highest-risk individuals from natural language, enabling swifter interventions.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.