Skip to content

Category

natural language processing

6,613 papers

#artificial intelligence Preprint Open access Oct 2026

Dynamic Positional Attention Modulation for Parameter-Efficient Fine-Tuning of Large Language Models

Parameter-efficient fine-tuning (PEFT) has become a standard approach for adapting large language models to downstream tasks. However, most existing PEFT methods rely on uniform and static adaptations, without accounting for the structured heterogeneity of attention across dimensions, heads, layers, and input tokens. I...

Dayan Pan, Jingyuan Wang, Xie Yu · 0 citations
#natural language process... Preprint Open access Oct 2026

OMIT the Action: Measuring Framing-Invariant Omission Bias under Philosophical Disagreement

As LLMs increasingly assist in moral reasoning, omission bias, the tendency to prefer inaction even when equivalent framings reverse substantive outcomes, poses a significant risk of skewed decision-making. Yet omission bias remains underexplored in LLM evaluation, with the few existing studies limited in scale and foc...

Sihyeon Lee, Jihun Song, Chanwoo Kim et al. · 0 citations
#natural language process... Preprint Open access Oct 2026

Nucleus Speculative Decoding: Plausibility-Aware Verification Beyond Exact Distribution

Speculative decoding accelerates autoregressive generation by using a lightweight draft model to propose multiple tokens that are verified by a target model in parallel. However, the standard acceptance rule focuses on exact distribution correction and rejects tokens that remain highly plausible under the target model...

Shuhao Li, Fanghua Ye, Wanyu Lin et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

One Step at a Time: Trading LLM Autonomy for Process Predictability

Organizations automating operational processes need more than a correct outcome: they need to predict how a process will run, know which one actually ran, and inspect it step by step. When an agent is the executor that predictability is normally lost: the prescribed procedure goes into the system prompt, and only a fin...

Hans Schabert, Christoph Peters · 0 citations
#natural language process... Preprint Oct 2026

Reading, Not Manipulating: Leveraging Router Logits for Multimodal Safety in MoE Vision-Language Models

Vision-language models (VLMs) face compositional safety risks where harmful intent emerges from the interaction between visual and textual inputs. As mixture-of-experts (MoE) VLMs become increasingly common, recent work has explored various safety interventions, including prompting, supervised fine-tuning, and routing-...

Zi-Yuan Yang, Wen-Xuan Ding, Shang-Bin Feng et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

No Transformer Beats Six Covariates: Long-Horizon Prediction of Depressive Symptoms from Childhood Essays

Natural language processing (NLP) models can detect depression-related language in text written near the time symptoms are measured, but whether pretrained transformers can predict depressive symptoms from text written twelve years earlier is largely untested. In the National Child Development Study, a British birth co...

Daniel Kua, Emrul Hasan, John-Jose Nunez et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

From Evidence to Action: How Tool-Using Agents Fail

Tool-using agents make consequential changes to external state, yet correct outcomes do not guarantee that their actions were supported by evidence established beforehand. We study where this evidence-to-action chain breaks as agents move from deciding whether to act to executing single actions and dependent workflows....

Hongzhan Lin, Shidong Cao, Ziyang Luo et al. · 0 citations
#natural language process... Preprint Open access Oct 2026

Does Steering Break Your Model? A Multi-Dimensional Evaluation Suite for LLM Steering Methods

Activation steering provides a lightweight and flexible way to control large language model (LLM) behavior. However, effective steering requires more than inducing the intended behavior: it should also limit unintended changes and remain robust across inputs and training data. Existing evaluations cover these dimension...

Haotian Yang, Huikang Jiang, Yucheng Wu et al. · 0 citations
#natural language process... Preprint Open access Oct 2026

Readout Stability in Prefill-Only Decision Models:Zero-Label Prediction and Inference-Time Compute Allocation

Prefill-only decision models inspired by the Jev model score every candidate in a menu during a single forward pass and never decode, which makes one call one to two orders of magnitude cheaper than a same-scale generative language model. We show that this read-out structure comes with a testable property. When an inte...

Ran Li, Lei Chen · 0 citations
#natural language process... Preprint Open access Oct 2026

Detecting LLM-Assisted Vietnamese Writing via Keystrokes under Behavioral Manipulation

We study the robustness of keystroke dynamics for detecting large language model (LLM)-assisted writing. We introduce a Vietnamese keystroke dataset capturing realistic writing modes, including bona fide composition, transcription, and paraphrasing. We also define a behaviorally grounded threat model in which users del...

Thanh Dong, An Ngo, Minh Dau et al. · 0 citations
#natural language process... Preprint Open access Oct 2026

DLoop: Looped Speculative Decoding

Speculative decoding accelerates autoregressive generation in large language models. In each drafting stage, a lightweight draft model proposes tokens that the target model subsequently verifies. With increasingly capable draft models, we find that the target model frequently accepts all tokens produced in a drafting s...

Geonmo Gu, Byeongho Heo, HeeJae Jun et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Monte Carlo Estimation for KV Cache Eviction

Most KV-cache eviction methods ask, in effect, which memory appeared important while reading the prompt? We instead ask, which memory will matter while answering? Since decoding queries are unavailable at eviction time, prior future-aware methods rely on pseudo-responses or synthetic future-query estimates. We cast fix...

Ahsan Bilal, Muhammad Ahmed Mohsin, Muhammad Umer et al. · 0 citations

From tech blogs

See all →
MIT News · Artificial Intelligence Sep 24, 2026

Estimating suicide risk from text

A new language-processing tool could help identify the highest-risk individuals from natural language, enabling swifter interventions.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.