Skip to content

Category

natural language processing

7,968 papers

#natural language process... Preprint Sep 2026

A literature-guided descriptor-based framework for filtering composition search spaces

A literature-guided descriptor-based filtering framework for reducing composition search spaces and shows that literature-derived embeddings can support intuitive and reproducible filters for narrowing candidate composition spaces while preserving high-performing compositions.

Lei Zhang, Markus Stricker · 0 citations
#machine learning Preprint Open access Sep 2026

Equal Ranking Quality, Different Decisions: Measuring and Reducing Order Dependence in LLM Scorers

In passage reranking, response ranking and multi-document question answering, LLMs can score several candidate documents or responses together in one prompt, each still receiving its own score. Such scorers are selected on ranking quality, but their scores determine a decision: what a score threshold retains, a reader...

Markus Frohmann, Mahdiyar Ali Akbar Alavi, Elizabeth Lingg et al. · 0 citations
#machine learning Preprint Jun 2026

Affix Cache for Diffusion Large Language Models

ACache is presented, a cross-request cache reuse mechanism for shared spans, or affixes, at any position: prefix, infix, or suffix, and co-designs it with a modern inference engine, whose attention reads each request's recomputed Anchor KV states alongside one affix cache shared across concurrent requests.

Kai-Huan Liang, An Zhong, Xin Tan et al. · 0 citations
#machine learning Preprint Aug 2026

WhiteMatter: All-to-All Cross-Layer Connections via KV Source Mixing

The introduction of WhiteMatter, which allows every layer to draw on past-token representations from any depth, and cyclic iteration, which updates interleaved groups of tokens in turn while processing the tokens within each group in parallel.

Wen-Bo Zhang, Xiang Ren · 0 citations
#machine learning Preprint Jun 2026

Capability Provenance in Language Models: A Case Study in Social Reasoning

We use training-data attribution as an interpretable tool for capability discovery, mapping which regions of the pretraining corpus support social reasoning versus STEM reasoning in OLMo3-7B. Training-data attribution measures how strongly each training document influences a model's predictions on a benchmark, but docu...

Glenn Scott Matlin, Chandreyi Chakraborty, Saehee Eom et al. · 0 citations
#machine learning Preprint May 2026

Beyond Imitation: Reflective On-Policy Self-Distillation for LLM Reasoning

Experiments show that Reflective On-policy Self-Distillation (ROSD), which distills transferable reasoning insights rather than complete reference trajectories, consistently outperforms standard OPSD and reinforcement learning baselines, better preserves reasoning diversity, stabilizes training, and mitigates late-stag...

Zi-Qi Zhao, Xin-Yu Ma, Liu Yang et al. · 16 citations

Max-pooling Network Revisited: Analyzing the Role of Semantic Probability in Multiple Instance Learning for Hallucination Detection

This work revisits classical sentence classification models from a margin enlargement perspective, aggregating token-level features via max pooling and directly estimating sentence scores using a lightweight MLP, and achieves substantial efficiency improvements while maintaining competitive performance with state-of-th...

Shota Fujikawa, Issei Sato · 0 citations
#machine learning Preprint Open access Sep 2026

Prosodic ABX: A Language-Agnostic Method for Measuring Prosodic Contrast in Speech Representations

Speech representations from self-supervised speech models (S3Ms) are known to be sensitive to phonemic contrasts, but their sensitivity to prosodic contrasts has not been directly measured. The ABX discrimination task has been used to measure phonemic contrast in S3M representations via minimal pairs. We introduce pros...

Haitong Sun, Stephen McIntosh, Kwanghee Choi et al. · 0 citations
#machine learning Preprint Open access Sep 2026

SWE-Adept: An LLM-Based Agentic Framework for Deep Codebase Analysis and Structured Issue Resolution

Large language models (LLMs) exhibit strong performance on self-contained programming tasks. However, they still struggle with repository-level software engineering (SWE), which demands (1) deep codebase navigation with effective context management for accurate localization, and (2) systematic approaches for iterative,...

Kang He, Kaushik Roy · 0 citations
#machine learning Preprint Oct 2025

R2T: Rule-Encoded Loss Functions for Sequence Tagging in Low-Resource Languages

Rule-to-Tag (R2T), a framework that turns linguistic rules into the training signal for neural sequence taggers in low-resource languages, is introduced, a first instance of a broader paradigm the authors call principled learning (PrL): using explicit principles as a learning signal, rather than relying on example-base...

Mamadou K. Keita, Christopher Homan, Sébastien Diarra · 2 citations
#machine learning Preprint Open access Sep 2026

Large Language Model Selection with Limited Annotations

Choosing a Large Language Model (LLM) for a given task requires comparing many strong candidates, yet standard evaluation relies on costly annotations over fixed evaluation sets. To address this challenge, we develop SELECT-LLM, the first framework for active model selection of LLMs. SELECT-LLM aims to find a small set...

Yavuz Durmazkeser, Patrik Okanovic, Andreas Kirsch et al. · 0 citations

From tech blogs

See all →
MIT News · Artificial Intelligence Oct 15, 2026

AI model decodes the language cells use to communicate

A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.

Microsoft Research Blog Oct 15, 2026

Proof-based general-purpose computing with Magnetar

Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.

MIT News · Artificial Intelligence Sep 24, 2026

Estimating suicide risk from text

A new language-processing tool could help identify the highest-risk individuals from natural language, enabling swifter interventions.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.