Skip to content

Category

natural language processing

9,261 papers

#natural language process... Preprint Open access Sep 2026

Reviser: Revision-Capable Text Generation via Autoregressive Cursor Actions

Revision-capable generation is appealing because it can insert or revise earlier content, but many non-autoregressive and edit-based approaches obtain this flexibility through repeated sequence-level computation. We propose Reviser, a decoder-only Transformer that generates a response as a sequence of cursor-relative a...

Sean Diab · 0 citations

SAGE: Schema-Guided LLMs for Grant Review

SAGE, Schema-Guided Aspect-Based Grant Evaluation, a system that translates a grant rubric into structured checks and links its judgements to evidence from the application package is presented.

Erik Varapaev, A. Chetvergov, S. Ukolov et al. · 0 citations
#natural language process... Preprint Open access Sep 2026

From Discharge Notes to Patient Understanding: Persona-Grounded, Open-Ended Simulation of LLMs as Discharge Educators

Hospital discharge education is an interactive teaching task: a clinician adapts a discharge plan to a patient's literacy, recall, and personality. Existing LLM evaluations target static or artifact-generation tasks and do not measure patient understanding under open-ended dialogue. We introduce DischargeBench, a perso...

Won Seok Jang, Zonghai Yao, Hong Yu · 0 citations
#natural language process... Preprint Jul 2026

Do small language models know what they don't know?

This work demonstrates that semantic entropy, computed by generating multiple samples, clustering answers by meaning, and measuring distributional uncertainty, recovers a viable confidence signal and suggests that the value proposition for entropy-based methods in SLMs is not computational savings but intelligent compu...

P. Mudgal · 0 citations
#machine learning Preprint Open access Sep 2026

Recall Before Rerank: Benchmarking Deep Learning Models for Large-Scale Code-to-Code Retrieval

Semantic code search and clone detection are essential for software development, maintenance, and reuse. This paper evaluates the effectiveness, efficiency, and scalability of contemporary deep learning models for first-stage recall in large-scale code-to-code search engines. Benchmarking across multiple programming la...

Leonardo Venuta, Francesco Tosoni, Paolo Ferragina · 0 citations
#machine learning Preprint Jan 2026

Semantic Calibration Prevails Where Token Confidence Fails: Benchmarking Long-Form Scientific QA

This work introduces the first large-scale benchmark for UQ calibration in long-form, reasoning-demanding scientific QA, evaluating four UQ methods on 685,000 responses across up to 20 LLMs and seven datasets, supported by an extensible open-source framework whose shared-generation design enables reproducible cross-met...

Philip Müller, Nicholas Popovic, Michael Färber et al. · 4 citations · ⚡1
#machine learning Preprint Open access Sep 2026

SteganoBackdoor: Evading Data-Poisoning Defenses via Steganographic Backdoors

Transformer-based models are highly susceptible to backdoor attacks via supervised fine-tuning (SFT). To red-team existing data-poisoning defenses, prior work has increasingly focused on stylized triggers, synthetic artifacts, and token-level perturbations designed to evade detection. However, this trend has shifted th...

Eric Xue, Ruiyi Zhang, Pengtao Xie · 0 citations
#machine learning Preprint Sep 2026

Predictable Failure in Multi-Hop Retrieval: Score-Distributional Confidence Scoring and Abstention

It is proved that no single ANN score feature achieves best predictive performance across all failure regimes; the dominant feature differs between datasets (query length on MuSiQue, hop-1 concentration on HoVer), and a constructive witness pair shows each is necessary in one regime and non-contributory in the other.

Andre Bacellar · 2 citations
#machine learning Preprint Open access Sep 2026

RheoSampling: Resolving the One-Hot Dilemma in Stochastic Dynamic-Tree Speculative Decoding

Speculative decoding accelerates LLM inference by drafting multiple tokens in parallel, with tree-based methods further improving efficiency through hierarchical structures. Dynamic-tree methods such as EAGLE-3 perform well under greedy decoding via deterministic top-K expansion and global pruning. However, in stochast...

Qiao Hu, Yepeng Weng, Bo Zhang et al. · 0 citations
#machine learning Preprint Sep 2026

Analysing the Linearity of Linguistic Relations in Language Model Embedding Spaces

We propose a framework to analyse how strongly different linguistic relations are linearly encoded in language model embedding spaces. We formalise linear encoding via a constrained linear approximation over related and unrelated word pairs and apply this to an extended BATS dataset covering inflectional, derivational,...

Vasudevan Nedumpozhimana, Fathima Thekkekara, John D. Kelleher · 0 citations
#machine learning Preprint Sep 2026

Configurable Multi-Stage Vision Pipeline for Crop Disease and Pest Diagnosis

Farmer.Chat is Digital Green's farm advisory service for smallholder farmers. When something looks wrong with a crop, the farmer takes a photograph and sends it, and that photograph is the whole question: no symptom described, no crop named, often no text at all. The service has to determine whether the picture can be...

Naga Ganesh, S. ChandrashekarM, Lakshmi N. Pedapudi et al. · 0 citations
#machine learning Preprint Sep 2026

Prediction Dynamics in Depth-Recurrent Language Models

A sharp margin characterization is derived that decomposes the conservatism of a magnitude bound into common translation, direction relative to the winner, and the pairing of each competitor's update with its score gap to explain finite-depth answer preservation through the geometry and composition of observed score ch...

Xin-Yue Luo, Fei Yu · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

MIT News · Artificial Intelligence Oct 15, 2026

AI model decodes the language cells use to communicate

A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.

Microsoft Research Blog Oct 15, 2026

Proof-based general-purpose computing with Magnetar

Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.