Skip to content

Category

natural language processing

6,757 papers

#natural language process... Preprint Open access Oct 2026

Evaluating the Robustness of Japanese LLMs to IME-Related and Typographical Errors

Large language models (LLMs) have achieved strong performance across various natural language processing tasks. However, their robustness to typographical errors remains underexplored, particularly in Japanese, where text input involves multiple writing systems and IME-based conversion. In this study, we evaluate the r...

Ryota Mibayashi, Hiroaki Ohshima · 0 citations
#natural language process... Preprint Oct 2026

Harness Annealing: Learning to Act with Less External Control

Language agents rely on external harnesses to track state, organize workflows, and verify answers. Beyond providing tools and information, these harnesses supply control decisions about what to investigate, whether to revise, and when to stop. Training on successful harness-supported trajectories can improve task perfo...

Yingxuan Yang, Hua-Can Chai, Ying Wen · 0 citations
#natural language process... Preprint Open access Oct 2026

ASCRIBE: Atomic and Significance-Based Reasoning for Thai Clinical SOAP Note Generation

Automatic SOAP note generation can ease the documentation burden on physicians, but existing reasoning methods often omit clinically important information and generate unsupported content. Progress in Thai is further hindered by the lack of publicly available datasets. We propose ASCRIBE, a physician-inspired reasoning...

Tarm Kalavantavanich, Teerawut Ponarchar, Pattaramanee Arsomngern et al. · 0 citations
#natural language process... Preprint Oct 2026

AGO AI Quality Gate: Evidence-First Release Decisions for Retrieval-Augmented Generation

Enterprises adopting retrieval-augmented generation (RAG) face a recurring operational decision: promote, revise, or block a system version. The evidence is incomplete and the metrics come from fallible LLM judges. We report on AGO AI Quality Gate (AGO), an evidence-first quality-gate framework deployed in industrial R...

Giulio Zeloni, Enrico Lo Conte, Salvatore Rionero et al. · 0 citations
#natural language process... Preprint Oct 2026

HeadEdit: Calibrating Language Model Behavior Through the Frozen Unembedding Matrix

Alignment does not eliminate behavioral errors in language models. Models may still refuse benign requests, call unnecessary tools, or yield to false user claims. Current methods mitigate such errors as a computation problem, and rarely explore if the desired behavior is already encoded in the model's representation. M...

Zirui He, Hai-Yan Zhao, Jing-Yu Hu et al. · 0 citations
#natural language process... Preprint Oct 2026

My FAULT: Self-Diagnosis as Credit Assignment in Self-Evolving Agentic Reinforcement Learning

Agentic reinforcement learning (RL) has emerged as a powerful approach for training large language model agents on multi-step tasks, yet reliance on terminal outcome rewards creates two credit-assignment problems, particularly in long-horizon tasks. First, same-outcome rollout groups provide no learning signal from ter...

Yi-Hua Zhu, Qian-Ying Liu, Wei Qiao et al. · 0 citations
#natural language process... Preprint Oct 2026

BanglaDial-Abuse: A Corpus-Grounded Dataset for Regional Dialect Identification in Abusive Bangla Text

Regional linguistic variation remains an important challenge for Bangla natural language processing, particularly in informal and non-standard text. This paper introduces BanglaDial-Abuse, a balanced Bengali-script dataset developed for regional dialect identification in abusive and hostile Bangla text. The dataset con...

Hasin Almas Sifat · 0 citations
#natural language process... Preprint Oct 2026

Counting and Min-Cost Encoding for Tokenization in Large Language Models

Mainstream large language models rely on a tokenizer to encode text into a token sequence. Different tokenizers may yield token sequences of substantially different lengths for the same text. With a fixed model architecture, shorter token sequences correspond to lower inference time. We propose a tokenizer training app...

Shu-Ming Shi, Xiang Zhang, Hao-Yi Yu et al. · 0 citations
#natural language process... Preprint Oct 2026

AgSpec: Pushing the Limits of Retrieval-Based Speculative Decoding in Coding Agent Pipelines

Retrieval-based speculative decoding (SD) drafts tokens by copying continuations from existing text, which suits coding agents that repeatedly reproduce code, logs, and earlier attempts. Yet existing methods fall short in agent pipelines: much of the reusable text is missing from their corpora or stored in a form that...

Sumin Lee, Sukmin Cho, Suengjae Lim et al. · 0 citations
#natural language process... Preprint Open access Oct 2026

Precision over Scale: A Polish-Silesian Benchmark and a Translation System Outperforming Open-Source and Commercial Models

Dialectal machine translation remains challenging due to limited data and strong linguistic variation not captured by standard benchmarks, which often assume standardized and well-edited text. We study Polish-Silesian MT using neural and rule-based systems, evaluating on SiLTT - a new Pol-Szl testset, alongside establi...

Grzegorz Kulik, Miko{\l}aj Pokrywka, Adam Jatowt et al. · 0 citations
#natural language process... Preprint Oct 2026

Probe with Participation Trophies: Random-Reward RL as a Probe of LLM Capability

We connect the spurious-reward paradox to a model's reachability and propose random-reward reinforcement learning (RL) as a useful tool for the probing enterprise, addressing a decade-long debate over what probing performance actually reveals about a model. There are two prevailing explanations for the surprising findi...

Yu-Zhu Mao, Lei Yu, Zi-Ning Zhu et al. · 0 citations
#natural language process... Preprint Oct 2026

LawCompass: Navigating from Legal QA to Multi-Agent Deep Research with Grounded Evidence

Recent advances in Large Language Models (LLMs) and Retrieval-Augmented Generation (RAG) have significantly democratized access to legal information. Nevertheless, most existing legal assistants remain confined to multi-turn conversational QA, failing to support complex legal tasks that require systematic evidence retr...

Xiaoxia Cheng, Lin-Nan Wang, Jia-Hao Ma et al. · 0 citations

From tech blogs

See all →
MIT News · Artificial Intelligence Sep 24, 2026

Estimating suicide risk from text

A new language-processing tool could help identify the highest-risk individuals from natural language, enabling swifter interventions.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.