Skip to content

Category

natural language processing

7,546 papers

#machine learning Preprint Sep 2026

Doc2LoRA Provides Decodable Representations of Scientific Ideas

Representing scientific papers as points in a space lets us search for similar papers and inquire about how fields relate to one another and drive innovation. Beyond search, the vector space of papers invites generation: mixing papers through simple vector operations creates new points, mirroring combinatorial novelty,...

Chand Sahil Mansuri, Joel Zachariah, Sadamori Kojaku · 0 citations
#machine learning Preprint Sep 2026

Which Models Work Well Together? Measuring Heterogeneity for LLM Team Selection

The performance ceiling of an LLM team is constrained not only by individual model capabilities, but also by inter-member error resonance and predictive differences. Although heterogeneous teaming is often observed to be effective in practice, existing approaches lack complementarity metrics that are computable, interp...

Liang-Yu Teng, Heng-Song Liu, Jun-Cen Guo et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Conformal Factuality Control for Multi-Hop Retrieval-Augmented Generation

Retrieval-augmented generation (RAG) can ground large language models in external evidence, but retrieved context does not guarantee that generated claims are factually supported. This problem is especially relevant in multi-hop RAG, where retrieval and reasoning proceed through multiple dependent stages. We study whet...

Muhammad Aimal Rehman, Chi-Kuang Yeh · 0 citations
#machine learning Preprint Sep 2026

TutlAit v1: a crowdsourced Moroccan Tamazight speech dataset with Arabic transcriptions and regional accent labels

Tamazight (Amazigh) is, together with Arabic, one of the two official languages of Morocco, yet it remains severely under-resourced for speech technology: pub licly available labelled audio is scarce, generally lacks information on the regional variety spoken, and is often of uneven transcription quality. This article...

M. Chadi, Ezzahra Ait El Arbi, Ismail Khayoub et al. · 0 citations
#machine learning Preprint Sep 2026

The System Prompt Illusion: How Instruction Preambles Modify Computation in Language Models

System prompts are the primary lever practitioners use to control language model behavior, yet what they actually do to the computation inside the transformer remains poorly understood. Across 17 instruction-tuned models spanning 8 architecture families and 1.5B to 72B parameters, we use Centered Kernel Alignment (CKA)...

Muhammad Usama, Dong Eui Chang · 0 citations
#machine learning Preprint Open access Oct 2026

Ranking-Aware Prompt Optimization for Multimodal Clinical Diagnosis

Multimodal large language models (MLLMs) are rapidly advancing clinical diagnosis, yet their adaptation pipelines remain anchored to accuracy-based objectives. Clinical data are heavily class-imbalanced: a constant-majority predictor can score above 90% accuracy while being clinically useless. We therefore evaluate and...

Tian Xia, Minghao Liu, Yiqing Liang et al. · 0 citations
#machine learning Preprint Sep 2026

Distribution Matching Distillation for Continuous Diffusion Language Models

Continuous diffusion language models generate all tokens in parallel, yet high-quality generation can still require hundreds of network evaluations (NFEs). We study how distributional distillation can reduce this cost by exploiting the student's probabilistic token outputs. Our unified formulation connects the student'...

Paul Le Van Kiem, Dario Shariatian, Umut Simsekli et al. · 0 citations
#machine learning Preprint Sep 2026

Cheap to Draw, Expensive to Trust: Certifying Test-Time Scaling Curves

Sampling several answers and keeping the one a verifier scores highest is one of the simplest ways to buy accuracy at test time. Its effect is reported as a scaling curve: accuracy against the number $k$ of sampled answers. The curve is cheap to draw and expensive to trust. A budget read off it is chosen after looking...

S. Sarkar, S. Baichoo · 0 citations
#machine learning Preprint Sep 2026

Learning Functional Subspaces for Neural Network Compression

Modern transformers pair impressive capabilities with substantial memory and compute demands. Low-rank weight factorization reduces both while keeping the matrices dense, and thus efficient on standard hardware. Existing methods, however, choose the subspace to remove from each weight matrix with local closed-form crit...

Massimo Bini, Anders Christensen, S. Alaniz et al. · 0 citations
#machine learning Preprint Sep 2026

LARC: Low-Rank Adaptive Residual Connections for Learning in Frozen Models

Low-Rank Adaptive Residual Connections (LARC) give a frozen model a compact numerical state that can learn from feedback. The map $h+BAh$ adds a low-rank correction to a hidden representation. A slow state $\rho$ learns starting factors across tasks; a private fast state $\Phi$ copies them, changes with feedback, and r...

Jun-Yi Zou, Avrova Donz · 0 citations
#machine learning Preprint Sep 2026

RoPE at the End of Its Rope? Theory, Diagnosis, and Mitigation of Long-Context Failures

Long-context failures of RoPE-based language models can arise from RoPE's intrinsic tradeoff between maintaining stable token preferences and distinguishing nearby positions. Determining which weakness to address, and how, requires a more precise characterization of RoPE's behavior in trained models across context leng...

Yu-Yang Wu, Yu-Feng Du, Hao Peng · 0 citations
#machine learning Preprint Open access Oct 2026

When the Right Answer Is Missing: An Arithmetic-Dependent Rejection Bottleneck in Jev

Typed decision models such as Jev offer an efficient alternative to generative LLMs in decision-making workflows by selecting directly from predefined options. When candidate sets contain no valid answer, TypeSafe recommends including an "other" or "none-of-the-above" option to enable rejection. In this report, however...

Jike Zhong, Ming Li, Yuxiang Lai · 0 citations

From tech blogs

See all →
MIT News · Artificial Intelligence Sep 24, 2026

Estimating suicide risk from text

A new language-processing tool could help identify the highest-risk individuals from natural language, enabling swifter interventions.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.