Skip to content

Category

natural language processing

8,685 papers

#natural language process... Preprint Mar 2026

LLM-as-a-judge validity is strongly task-dependent across physics assessment formats

As large language models (LLMs) are increasingly considered for automated assessment and feedback, understanding when LLM marking is valid is essential. We evaluate LLM-as-a-judge marking across four settings spanning three assessment formats - structured questions, written essays, and scientific plots - comparing GPT-...

Will Yeadon, Tom Hardy, P. Mackay et al. · 2 citations

ChEmbed: Enhancing Chemical Literature Search Through Domain-Specific Text Embeddings

ChEmbed is introduced, the first purpose-built family of domain-adapted text embedding models engineered for chemical literature retrieval, and represents a practical, lightweight, and reproducible embedding solution that effectively improves chemical literature retrieval.

Ali Shiraee Kasmaee, Mohammad Khodadad, Mehdi Astaraki et al. · 4 citations · ⚡1
#natural language process... Conference Jun 2025

Reachability in symmetric VASS

The reachability problem in symmetric vector addition systems with states (VASS), where transitions are invariant under a group of permutations of coordinates, is investigated and the gain in complexity when the group arises as a combination of the trivial and symmetric groups is estimated.

Lukasz Kaminski, Slawomir Lasota · 1 citation
#natural language process... Preprint May 2025

Decoding One Safety Trigger Token for Balancing Safety and Usability in Large Language Models

D-STT, a simple yet effective defense algorithm that identifies and explicitly decodes safety trigger tokens of the given safety-aligned LLM to activate the model's learned safety patterns, effectively preserves model usability by introducing minimum intervention in the decoding process.

Hao-Ran Gu, Han-Ding Wang, Yi Mei et al. · 0 citations
#natural language process... Preprint Aug 2026

Recovering General Capabilities via Uncertainty-Calibrated Multi-Teacher On-Policy Distillation

The proposed Uncertainty-Calibrated MOPD (UCMOPD), which addresses limitations of standard MOPD through two complementary mechanisms, improves the general-capability average over standard MOPD by $4.48\% and $7.86\% while maintaining vertical-domain performance.

Zi-Yuan Liu, Jiao Ou, Jian Liang et al. · 0 citations

ChildSafeAds Shared Task 2026: Commercial Content in Child-Facing YouTube Videos

Across four system papers, the linked promotional page mainly helped identify what was being sold and added little to compliance-risk classification, which exposed sensitivity to rare labels, advertiser overlap across splits and substantial variation in the ST3 labels.

Thales Bertaglia, Catalina Goanta, Gerasimos Spanakis et al. · 0 citations
#natural language process... Preprint Open access Sep 2026

Token Distribution versus Data Volume: Domain Balancing in Multi-Domain Meeting Summarisation

Jointly fine-tuning an LLM on meeting-summarisation corpora of widely varying size raises a question that prior work leaves confounded: when a domain-balanced training mixture helps, is the gain due to the distribution of tokens across domains, or merely to the volume of data seen? We disentangle these factors by const...

Ashima Sood, Bryan Gardiner, Joan Condell · 0 citations

Policy-Conditioned Constrained Decoding for Column-Level Access Control in Text-to-SQL

A per-token logits mask is applied that deterministically eliminates single-query column-use violations on the supported SQL fragment in a single decoding pass and achieves 0% Leakage Rate and Coverage up to 88.7% on Spider-CU, while staying within +10% tokens of direct prompting.

Ryoto Miyamoto, Xin Fan, Hayato Yamana · 0 citations

JetSpec: Breaking the Scaling Ceiling of Speculative Decoding with Parallel Tree Drafting

JetSpec is proposed, a head-based SD framework that combines one-forward drafting efficiency with branch-wise causal conditioning that enables JetSpec to convert larger draft budgets into longer accepted prefixes and higher end-to-end speedup.

Lan-Xiang Hu, Zhao-Xiang Feng, Yulun Wu et al. · 15 citations · ⚡1
#natural language process... Preprint Open access Sep 2026

The Holistic Storage of Verb+Up Phrases in Text-based and Audio-based Language Models

One of the most central aspects of language processing is the ability to trade off between stored representations and abstract knowledge: one must retrieve stored representations, but also generate novel ones by applying productive rules. While recent work has examined abstract knowledge in language models, holistic st...

Zachary Nicholas Houghton, Yu Zhou, Dan Pluth et al. · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

MIT News · Artificial Intelligence Oct 15, 2026

AI model decodes the language cells use to communicate

A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.

Microsoft Research Blog Oct 15, 2026

Proof-based general-purpose computing with Magnetar

Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.

MIT News · Artificial Intelligence Sep 24, 2026

Estimating suicide risk from text

A new language-processing tool could help identify the highest-risk individuals from natural language, enabling swifter interventions.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.