Skip to content

Category

natural language processing

6,613 papers

#artificial intelligence Preprint Oct 2026

CroissantMiner: Automated Extraction and Validation of Croissant Metadata for ML Datasets

Croissant has emerged as a standard for machine-readable dataset metadata, yet populating its fields remains labor-intensive and requires careful reading of accompanying dataset documentation. We present the first benchmark enabling end-to-end evaluation of metadata extraction aligned with a community-standard schema....

Berke Arda, Ahmetcan Yavuz, Paul Gerry et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Jailbreaking Open-Weight LLMs via Random Embedding Perturbations

While open-weight models have enjoyed steady progress in capabilities and wide adoption across multiple domains, their safety remains an important concern. One key feature is the ability to refuse or deflect harmful, malicious, or insensitive prompts. In this paper, we expose safety vulnerabilities across six common op...

Abhinav Sudhakar Dubey (University of California Santa Cruz), Scott Sirri (University of California Santa Cruz), Vaggos Chatziafratis (University of California Santa Cruz) et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Investigating Model Compression for Neural Machine Translation in the Biomedical Domain

Large-scale pretrained transformer models have achieved state-of-the-art performance across diverse machine translation tasks, including multilingual settings. Knowledge distillation has emerged as a sustainable approach for model compression, transferring knowledge from large teacher models to smaller, more efficient...

Maria Zafar, Souhail Bakkali, Rejwanul Haque · 0 citations
#machine learning Preprint Open access Oct 2026

Calibrated Answers About Randomized Trials From a 4-Billion-Parameter Open Model: A Registered Test and a License-Clean Release

Fiorillo v0.5 is an open model that answers typed questions with a probability for each answer. Its main specialist reads a randomized trial's article, cut to 6,144 tokens, and answers whether an intervention significantly increased, significantly decreased or did not significantly change an outcome against a comparato...

Johann Emmanuel Li · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Component and Dimension Sparsity in Transformer Refusal Mechanisms

Activation steering manipulates large language model behavior by intervening on internal activations, but the mechanistic basis of these interventions remains poorly understood. We decompose refusal steering into component-level interventions across four open-weight models, identifying the sparse subsets of attention a...

Vincent Siu, Glenn Grant-Richards, Vlad Pavlovich et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Zero-Shot Visualization: Exploring Text Corpora with User-Prompted Axes

We study the application of large language models (LLMs) to the visual exploration of textual corpora. We introduce zero-shot visualization (ZSV), a task in which users specify concepts in natural language and documents are mapped onto the corresponding concept axes for visualization. Building a ZSV system of practical...

Arnau Bueno Tricas, Jose A. Rodr\'iguez-Serrano · 0 citations
#machine learning Preprint Oct 2026

A Systematic Study of Small Language Models on Abstract Reasoning Tasks

Endpoint accuracy on abstract-reasoning benchmarks does not reveal whether a language model has acquired a transferable rule or fit distribution-specific regularities. We study this distinction in small language models on the ARC-TGI benchmark, which organizes abstract grid transformations into controllable task famili...

Nur A. Zarin Nishat, Jens Lehmann, Andrei C. Aioanei et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Principled Under Pressure: Post-Training Decides Whether LLMs Act on Their Own Moral Judgment

Language models increasingly act as agents. An agent that says an action is wrong and then takes it anyway is a different failure from one that does not know better, and evaluations of stated values cannot see it. We build a pre-registered panel of 248 scenarios across five kinds of pressure. Each scenario is posed twi...

Orion Reblitz-Richardson · 0 citations
#artificial intelligence Preprint Oct 2026

DeltaTTT: Layerwise Optimization for Nonlinear Recurrent Memory

Sequential test-time training adapts a memory network through successive updates, each computing an inner-loop gradient based on the network's previous state. Intuitively, this state dependence should allow each update to account for what the memory has already learned and better incorporate new information. However, w...

Yi-Ning Li, Dong-Chen Han, Jie Fu et al. · 0 citations
#machine learning Preprint Oct 2026

Align, Then Correct: Training-Free Two-Stage Low-Rank Compensation for Extremely Quantized Large Language Models

Low-rank quantization error compensation (LQEC) recovers the accuracy lost under aggressive weight quantization by attaching a closed-form rank-$r$ adapter beside each frozen quantized weight, without any training. We show that existing compensators are limited by two shared simplifications. They calibrate symmetricall...

Seobin Song, Geonho Lee, Janghwan Lee et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Symphony for Text Generation: Benchmarking Clinical Note Generation

Ambient documentation systems are rapidly gaining adoption, yet their impact on clinical note quality remains poorly characterized. We introduce MedConv, a multilingual dataset of 300 clinical encounters in English, Danish, and German, and use it alongside the Ambient Clinical Intelligence benchmark (ACI-BENCH) to comp...

Daniel Varab, Victor Petr\'en Bach Hansen, Asbj{\o}rn W. Helge et al. · 0 citations
#machine learning Preprint Oct 2026

A Broader Look at Model Merging: Rethinking Implicit Regularization Induced by Task Arithmetic

Model merging aims to build a multi-task model cheaply by combining the weights of individual task-specific models. To perform well across multiple tasks, most existing merging methods use an additional dataset to find the coefficients for the best linear combination of task-specific weight updates. However, we identif...

Sin-Han Yang, Shih-Cheng Huang, Chieh-Yen Lin et al. · 0 citations

From tech blogs

See all →
MIT News · Artificial Intelligence Sep 24, 2026

Estimating suicide risk from text

A new language-processing tool could help identify the highest-risk individuals from natural language, enabling swifter interventions.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.