Skip to content

Category

natural language processing

7,304 papers

#artificial intelligence Preprint Feb 2026

ResidualKV: Residual-Based KV Cache Compression for Efficient Long-Context Inference

ResidualKV is proposed, which factorizes the KV cache into a sparse set of globally retrieved references and compact, quantized residual codes for the remaining tokens, and shows that global cross-token redundancy supports accurate, memory-efficient, and computation-efficient long-context inference.

Jitai Hao, Qiang Huang, Yaowei Wang et al. · 10 citations · ⚡1
#artificial intelligence Preprint Open access Oct 2026

Functional Subspace, where language models can use vector algebra to solve problems

Large language models (LLMs) were invented for natural language tasks such as translation, but they have proved that they can perform highly complex functions across domains. Additionally, they have been thought to develop new skills without being trained on them. These learning capabilities lead to LLMs adoption in a...

Jung H. Lee, Sujith Vijayan · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Context-Aware Classification and Grading of Sensitive Information in Online Conversational Health Data

Online medical consultations contain sensitive health information whose privacy implications depend not only on the entities mentioned but also on how those entities are described in context. Existing classification and grading approaches often map health-information entities directly to predefined sensitivity levels,...

Yiwei Yan, Guanfeng Liu · 0 citations
#artificial intelligence Preprint Open access Oct 2026

From Compound Figures to Medical Multi-image Reasoning: Scaling Multimodal Large Language Models with Biomedical Literature

Multimodal large language models (MLLMs) are increasingly capable in medical imaging, yet most focus on single-image settings. Clinical interpretation often requires integrating evidence across multiple images, such as different modalities, views, or time points. However, large-scale medical multi-image data and traini...

Zhen Chen, Yihang Fu, Rong Zhou et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Generative AI Purpose-built for Social and Mental Health: A Real-World Pilot

Generative AI chatbots built for mental health could extend access to care, but evidence from real-world use is limited. We report a single-arm, naturalistic pilot of a foundation model trained for mental health, among 299 US adults with at least moderate depressive or anxiety symptoms who were followed for up to 12 mo...

Thomas D. Hull, Lizhe Zhang, Caitlin A. Stamatis et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

MedRECT: A Bilingual Medical Reasoning Benchmark for Error Correction in Clinical Texts

Large language models (LLMs) show promise in medical applications, but their ability to detect and correct errors in clinical texts remains under-evaluated, particularly beyond English. We introduce MedRECT, a bilingual benchmark for Japanese and English that formulates medical error handling as three subtasks: error d...

Naoto Iwase, Hiroki Okuyama, Junichiro Iwasawa · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Instruction Retrieval at Inference Time for Small Language Models

The facts a language model stores are tied to its parameter count, so small models that fit on edge devices fail on expert problems, which need specialized knowledge and follow multi-step procedures. Fine-tuning for a specific domain or task writes the knowledge into the parameters but must be repeated for every model...

Kenan Alkiek, David Jurgens, Vinod Vydiswaran · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Think Right: Learning to Mitigate Under-Over Thinking via Adaptive, Attentive Compression

Recent thinking models are capable of solving complex reasoning tasks by scaling test-time compute, but this scaling should be allocated in line with task difficulty. On one hand, short reasoning (underthinking) leads to errors on harder problems that require extended reasoning steps; but, excessively long reasoning (o...

Joykirat Singh, Justin Chih-Yao Chen, Archiki Prasad et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

From Construction to Injection: Edit-Based Fingerprints for Large Language Models

Reliable model fingerprints are essential for protecting large language models (LLMs) against unauthorized redistribution and commercial misuse. In black-box deployment, verification is hindered by defensive filtering of suspected fingerprint queries, as well as by downstream model modifications that may weaken embedde...

Yue Li, Xin Yi, Dongsheng Shi et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

NMIXX: Domain-Adapted Neural Embeddings for Cross-Lingual eXploration of Finance

Financial text embeddings must distinguish changes in event status, perspective, and obligations even when passages share similar wording. NMIXX adapts existing encoders through 18.8k source-linked triplets: paraphrases and Korean-English translations preserve meaning, while targeted financial rewrites introduce semant...

Hanwool Lee, Sara Yu, Yewon Hwang et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Cross-Layer Discrete Concept Discovery for Interpreting Language Models

Interpreting language models remains challenging due to the existence of residual stream, which linearly mixes and duplicates features across adjacent layers, causing single-layer analyses to miss this cross-layer structure. Cross-layer sparse autoencoders (SAEs) address layer mixing but operate in continuous space, wh...

Ankur Garg, Xuemin Yu, Hassan Sajjad et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Mitigating Memorization In Language Models

Language models (LMs) can "memorize" information, i.e., encode training data in their weights in such a way that inference-time queries can lead to verbatim regurgitation of that data. This ability to extract training data can be problematic, for example, when data are private or sensitive. In this work, we investigate...

Mansi Sakarvadia, Aswathy Ajith, Arham Khan et al. · 0 citations

From tech blogs

See all →
MIT News · Artificial Intelligence Sep 24, 2026

Estimating suicide risk from text

A new language-processing tool could help identify the highest-risk individuals from natural language, enabling swifter interventions.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.