Skip to content

Category

natural language processing

7,546 papers

#artificial intelligence Preprint Open access Oct 2026

Beyond LoRA vs. Full Fine-Tuning: Gradient-Guided Optimizer Routing for LLM Adaptation

Recent literature on fine-tuning Large Language Models highlights a fundamental debate. While Full Fine-Tuning (FFT) provides greater representational plasticity, Low-Rank Adaptation (LoRA) can match or surpass FFT performance while constraining updates to a low-rank space and potentially benefiting from additional reg...

Haozhan Tang, Xiuqi Zhu, Xinyin Zhang et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

VisionFoundry: Teaching VLMs Visual Perception with Synthetic Images

Vision-language models (VLMs) still struggle with visual perception tasks such as spatial understanding and viewpoint recognition, largely because natural image datasets provide limited supervision for low-level visual skills. Can targeted synthetic supervision address these weaknesses without reference images or manua...

Guanyu Zhou, Yida Yin, Wenhao Chai et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Semantic Chunking and the Entropy of Natural Language

Humans and large language models can predict next letter or word from its prior context much better than random guessing, indicating strong redundancy of language viewed as a stochastic process. Quantitatively this redundancy was estimated by Shannon to be around 80\%, which means that every letter of a printed English...

Weishun Zhong, Doron Sivan, Tankut Can et al. · 0 citations
#artificial intelligence Preprint Feb 2026

ResidualKV: Residual-Based KV Cache Compression for Efficient Long-Context Inference

ResidualKV is proposed, which factorizes the KV cache into a sparse set of globally retrieved references and compact, quantized residual codes for the remaining tokens, and shows that global cross-token redundancy supports accurate, memory-efficient, and computation-efficient long-context inference.

Jitai Hao, Qiang Huang, Yaowei Wang et al. · 10 citations · ⚡1
#artificial intelligence Preprint Open access Oct 2026

Functional Subspace, where language models can use vector algebra to solve problems

Large language models (LLMs) were invented for natural language tasks such as translation, but they have proved that they can perform highly complex functions across domains. Additionally, they have been thought to develop new skills without being trained on them. These learning capabilities lead to LLMs adoption in a...

Jung H. Lee, Sujith Vijayan · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Context-Aware Classification and Grading of Sensitive Information in Online Conversational Health Data

Online medical consultations contain sensitive health information whose privacy implications depend not only on the entities mentioned but also on how those entities are described in context. Existing classification and grading approaches often map health-information entities directly to predefined sensitivity levels,...

Yiwei Yan, Guanfeng Liu · 0 citations
#artificial intelligence Preprint Open access Oct 2026

From Compound Figures to Medical Multi-image Reasoning: Scaling Multimodal Large Language Models with Biomedical Literature

Multimodal large language models (MLLMs) are increasingly capable in medical imaging, yet most focus on single-image settings. Clinical interpretation often requires integrating evidence across multiple images, such as different modalities, views, or time points. However, large-scale medical multi-image data and traini...

Zhen Chen, Yihang Fu, Rong Zhou et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Generative AI Purpose-built for Social and Mental Health: A Real-World Pilot

Generative AI chatbots built for mental health could extend access to care, but evidence from real-world use is limited. We report a single-arm, naturalistic pilot of a foundation model trained for mental health, among 299 US adults with at least moderate depressive or anxiety symptoms who were followed for up to 12 mo...

Thomas D. Hull, Lizhe Zhang, Caitlin A. Stamatis et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

MedRECT: A Bilingual Medical Reasoning Benchmark for Error Correction in Clinical Texts

Large language models (LLMs) show promise in medical applications, but their ability to detect and correct errors in clinical texts remains under-evaluated, particularly beyond English. We introduce MedRECT, a bilingual benchmark for Japanese and English that formulates medical error handling as three subtasks: error d...

Naoto Iwase, Hiroki Okuyama, Junichiro Iwasawa · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Instruction Retrieval at Inference Time for Small Language Models

The facts a language model stores are tied to its parameter count, so small models that fit on edge devices fail on expert problems, which need specialized knowledge and follow multi-step procedures. Fine-tuning for a specific domain or task writes the knowledge into the parameters but must be repeated for every model...

Kenan Alkiek, David Jurgens, Vinod Vydiswaran · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Think Right: Learning to Mitigate Under-Over Thinking via Adaptive, Attentive Compression

Recent thinking models are capable of solving complex reasoning tasks by scaling test-time compute, but this scaling should be allocated in line with task difficulty. On one hand, short reasoning (underthinking) leads to errors on harder problems that require extended reasoning steps; but, excessively long reasoning (o...

Joykirat Singh, Justin Chih-Yao Chen, Archiki Prasad et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

From Construction to Injection: Edit-Based Fingerprints for Large Language Models

Reliable model fingerprints are essential for protecting large language models (LLMs) against unauthorized redistribution and commercial misuse. In black-box deployment, verification is hindered by defensive filtering of suspected fingerprint queries, as well as by downstream model modifications that may weaken embedde...

Yue Li, Xin Yi, Dongsheng Shi et al. · 0 citations

From tech blogs

See all →
MIT News · Artificial Intelligence Sep 24, 2026

Estimating suicide risk from text

A new language-processing tool could help identify the highest-risk individuals from natural language, enabling swifter interventions.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.