Skip to content

Category

natural language processing

6,756 papers

#artificial intelligence Preprint Open access Oct 2026

GrepSeek: Training Search Agents for Direct Corpus Interaction

Large Language Model (LLM) search agents have shown strong promise on knowledge-intensive tasks through iterative reasoning and retrieval. Most existing systems rely on retrievers that return ranked documents from a pre-built index. We explore a complementary paradigm in which the agent treats the corpus as the search...

Alireza Salemi, Chang Zeng, Atharva Nijasure et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

RA-MoE: Routing-Aligned Fine-Tuning for Multilingual Adaptation of Mixture-of-Experts Models

Mixture-of-Experts (MoE) models enable efficient LLM scaling, yet adapting them to non-English downstream tasks remains challenging. Standard multilingual fine-tuning largely ignores their heterogeneous routing structure. Across multiple MoE models and tasks, we find strong cross-lingual routing alignment in middle lay...

Guanzhi Deng, Kuan Wu, Haibo Wang et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

CHI-Bench: Can AI Agents Automate End-to-End, Long-Horizon, Policy-Rich Healthcare Workflows?

End-to-end automation of realistic healthcare operations stresses three capabilities underrepresented in current benchmarks: policy density, decisions must be grounded in a large library of medical, insurance, and operational rules; Multi-role composition: a single task requires the agent to play multiple roles with ha...

Haolin Chen, Deon Metelski, Leon Qi et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

WASIL: In-the-Wild Arabic Spoken Interactions with LLMs

Large Language Models (LLMs) voice assistants are commonly built as cascaded Automatic Speech recognition (ASR) to LLM systems, where recognition errors can distort user intent. Dislikes may also arise from ambiguous, out-of-domain, or non-request turns, making it hard to isolate ASR effects. We release WASIL (it denot...

Zien Sheikh Ali, Hamdy Mubarak, Soon-Gyo Jung et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Diagnosing Training Inference Mismatch in LLM Reinforcement Learning via a Zero-Mismatch Reference

Modern LLM RL systems separate rollout generation from policy optimization. These two stages are expected to produce token probabilities that match exactly. However, implementation differences can make them assign different values to the same sequence under the same model weights, inducing Training-Inference Mismatch (...

Tianle Zhong, Neiwen Ling, Yifan Pi et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Speech-based Psychological Crisis Assessment using LLMs

Psychological support hotlines provide critical support for individuals experiencing mental health emergencies, yet current assessments largely rely on human operators whose judgments may vary with professional experience and are constrained by limited staffing resources. This paper proposes a large language model (LLM...

Terumi Chiba, Yang Luo, Ziyun Cui et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Beyond LoRA vs. Full Fine-Tuning: Gradient-Guided Optimizer Routing for LLM Adaptation

Recent literature on fine-tuning Large Language Models highlights a fundamental debate. While Full Fine-Tuning (FFT) provides greater representational plasticity, Low-Rank Adaptation (LoRA) can match or surpass FFT performance while constraining updates to a low-rank space and potentially benefiting from additional reg...

Haozhan Tang, Xiuqi Zhu, Xinyin Zhang et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

VisionFoundry: Teaching VLMs Visual Perception with Synthetic Images

Vision-language models (VLMs) still struggle with visual perception tasks such as spatial understanding and viewpoint recognition, largely because natural image datasets provide limited supervision for low-level visual skills. Can targeted synthetic supervision address these weaknesses without reference images or manua...

Guanyu Zhou, Yida Yin, Wenhao Chai et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Semantic Chunking and the Entropy of Natural Language

Humans and large language models can predict next letter or word from its prior context much better than random guessing, indicating strong redundancy of language viewed as a stochastic process. Quantitatively this redundancy was estimated by Shannon to be around 80\%, which means that every letter of a printed English...

Weishun Zhong, Doron Sivan, Tankut Can et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

ResidualKV: Residual-Based KV Cache Compression for Efficient Long-Context Inference

Efficient long-context inference faces two coupled bottlenecks: KV-cache memory grows linearly with context length, while attention computation grows quadratically. Existing approaches typically address one at the expense of irreversible token eviction, full-cache retention, or full-history reconstruction, limiting the...

Jitai Hao, Qiang Huang, Yaowei Wang et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Functional Subspace, where language models can use vector algebra to solve problems

Large language models (LLMs) were invented for natural language tasks such as translation, but they have proved that they can perform highly complex functions across domains. Additionally, they have been thought to develop new skills without being trained on them. These learning capabilities lead to LLMs adoption in a...

Jung H. Lee, Sujith Vijayan · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Context-Aware Classification and Grading of Sensitive Information in Online Conversational Health Data

Online medical consultations contain sensitive health information whose privacy implications depend not only on the entities mentioned but also on how those entities are described in context. Existing classification and grading approaches often map health-information entities directly to predefined sensitivity levels,...

Yiwei Yan, Guanfeng Liu · 0 citations

From tech blogs

See all →
MIT News · Artificial Intelligence Sep 24, 2026

Estimating suicide risk from text

A new language-processing tool could help identify the highest-risk individuals from natural language, enabling swifter interventions.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.