Skip to content

Category

natural language processing

8,685 papers

#machine learning Preprint Sep 2026

The Key Handoff: Retrieval in Hybrid Language Models

Across twelve models, dense and hybrid, the authors move a hidden state from one story into another where the two routes lead to different places, and read off which place the model gives, which makes the answer a handoff.

Kaan Kale, Oğuzhan Başer, Sriram Vishwanath · 0 citations
#machine learning Preprint Sep 2026

USAI-Quant: A Quantitative Reasoning Benchmark for Vision-Language Models in Built Environments

The USAI-Quant benchmark is developed, the first benchmark designed to quantitatively evaluate VLM's reasoning capabilities on built environment metrics via remote sensing imagery, and reveals that current state-of-the-art models consistently fall short on numeric reasoning tasks.

Dong-Dong Wang, Q. Song, Yu-Zhou Chen et al. · 0 citations
#machine learning Review Sep 2026

OpenTumorBoard: A Real-World Benchmark of Multidisciplinary Tumor Board Discussion Trajectories

OpenTumorBoard is introduced, a benchmark with 611 patient cases and 19,157 discussion turns across ten specialist roles, transcribed from 12,534 minutes of publicly available tumor board recordings on YouTube, and automated curation pipeline is released to support the development and evaluation of LLMs for multidiscip...

An-Qi Li, Zhi-Xuan Ge, Yi-Xuan Duan et al. · 0 citations
#machine learning Preprint Sep 2026

KV-Lingo: Learning KV-Cache Translators with Distillation

KV-Lingo can be used for seamless model switching, staying close to re-prefill across repeated switches in the authors' multi-turn evaluations, and is found particularly useful for dynamic model routing.

Valérie Castin, Keitaro Sakamoto, A. Filippova et al. · 1 citation
#machine learning Preprint Sep 2026

HERO-MoE: Historical Expert Routing with Scale-Preserving Fusion

HERO-MoE, Historical Expert ROuting with Scale-Preserving Fusion, a routing framework that injects historical routing priors into MoE routers by reusing detached, dense routing distributions collected from preceding MoE layers by reusing detached, dense routing distributions collected from preceding MoE layers.

Jun-Xiang Qiu, Zheng-Su Chen, Xin-Ting Hu et al. · 0 citations
#machine learning Preprint Sep 2026

Groupwise Agentic Grading and Advantage Redistribution for Code Agent RL

Reinforcement learning (RL) for code agents often uses executable tests to provide binary rewards. With these rewards, Group Relative Policy Optimization (GRPO) assigns identical advantages to test-passing trajectories within each rollout group, overlooking differences in implementation quality and adherence to task re...

Jin-Hao Dong, Liang Zhao, Zi-Hao Yue et al. · 1 citation
#machine learning Preprint Sep 2026

Language as an Independent Information Layer: A Conceptual Model of Communication, Cognition and Decision-Making

A new concept for designing corporate knowledge bases is proposed that integrates the probabilistic vector space of a corporate vocabulary, reflect-ing industry specifics, subject focus, terminology, and culture, with traditional ontological modeling, and enables the efficient extraction of knowledge from accumulated c...

A. Alifanova, E. Benderskaya · 0 citations
#machine learning Preprint Open access Sep 2026

Masking Frequent Tokens Sharpens Direct Preference Optimization

Direct Preference Optimization (DPO) aligns language models by optimizing over sequence-level sums of token-wise implicit reward differences. However, we identify a pervasive pathology in this formulation: a disproportionately small subset of high-frequency token types dominates cumulative sequence scores while appeari...

Harshvardhan Saini, Samyak Jha, Yiming Tang et al. · 0 citations
#machine learning Preprint Sep 2026

Before Answering: Evidence Sufficiency under Size-Matched Memory Construction

Agents that answer questions from compressed or retrieved memory must recognize when the evidence a query needs is no longer in memory. Benchmarks for this task usually create insufficient-evidence examples by deleting supporting passages. We show that this construction leaks the label through memory size: on MuSiQue,...

Joyanta J. Mondal, Md. Shifatul Ahsan Apurba, Mridul Banik et al. · 1 citation

From tech blogs

See all →
Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

MIT News · Artificial Intelligence Oct 15, 2026

AI model decodes the language cells use to communicate

A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.

Microsoft Research Blog Oct 15, 2026

Proof-based general-purpose computing with Magnetar

Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.

MIT News · Artificial Intelligence Sep 24, 2026

Estimating suicide risk from text

A new language-processing tool could help identify the highest-risk individuals from natural language, enabling swifter interventions.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.