Skip to content

Category

natural language processing

7,776 papers

#natural language process... Preprint Aug 2026

Recovering General Capabilities via Uncertainty-Calibrated Multi-Teacher On-Policy Distillation

The proposed Uncertainty-Calibrated MOPD (UCMOPD), which addresses limitations of standard MOPD through two complementary mechanisms, improves the general-capability average over standard MOPD by $4.48\% and $7.86\% while maintaining vertical-domain performance.

Zi-Yuan Liu, Jiao Ou, Jian Liang et al. · 0 citations

ChildSafeAds Shared Task 2026: Commercial Content in Child-Facing YouTube Videos

Across four system papers, the linked promotional page mainly helped identify what was being sold and added little to compliance-risk classification, which exposed sensitivity to rare labels, advertiser overlap across splits and substantial variation in the ST3 labels.

Thales Bertaglia, Catalina Goanta, Gerasimos Spanakis et al. · 0 citations
#natural language process... Preprint Open access Sep 2026

Token Distribution versus Data Volume: Domain Balancing in Multi-Domain Meeting Summarisation

Jointly fine-tuning an LLM on meeting-summarisation corpora of widely varying size raises a question that prior work leaves confounded: when a domain-balanced training mixture helps, is the gain due to the distribution of tokens across domains, or merely to the volume of data seen? We disentangle these factors by const...

Ashima Sood, Bryan Gardiner, Joan Condell · 0 citations

Policy-Conditioned Constrained Decoding for Column-Level Access Control in Text-to-SQL

A per-token logits mask is applied that deterministically eliminates single-query column-use violations on the supported SQL fragment in a single decoding pass and achieves 0% Leakage Rate and Coverage up to 88.7% on Spider-CU, while staying within +10% tokens of direct prompting.

Ryoto Miyamoto, Xin Fan, Hayato Yamana · 0 citations

JetSpec: Breaking the Scaling Ceiling of Speculative Decoding with Parallel Tree Drafting

JetSpec is proposed, a head-based SD framework that combines one-forward drafting efficiency with branch-wise causal conditioning that enables JetSpec to convert larger draft budgets into longer accepted prefixes and higher end-to-end speedup.

Lan-Xiang Hu, Zhao-Xiang Feng, Yulun Wu et al. · 15 citations · ⚡1
#natural language process... Preprint Open access Sep 2026

The Holistic Storage of Verb+Up Phrases in Text-based and Audio-based Language Models

One of the most central aspects of language processing is the ability to trade off between stored representations and abstract knowledge: one must retrieve stored representations, but also generate novel ones by applying productive rules. While recent work has examined abstract knowledge in language models, holistic st...

Zachary Nicholas Houghton, Yu Zhou, Dan Pluth et al. · 0 citations

UXBench: Benchmarking User Experience in AI Assistants

The first user-centric benchmark grounded in real user feedback signals for evaluating preference alignment and dialogue generation is presented, demonstrating that user feedback prediction is a learnable capability and revealing different aspects that influence user experience.

Mengze Hong, Xia Zeng, Zeyang Lei et al. · 1 citation

Inside the LLM Word Factory

This work ventures deep into detokenization using activation patching in controlled paired experiments that isolate the contribution of different model components, localizing English detokenization in Llama2-7B to a two-stage process at Layer 1.

Benzi Busigin, Yuval Pinter · 0 citations
#natural language process... Preprint Open access Sep 2026

ReadingMachine: A Computational Methodology for Structured Corpus Reading and Large-Scale Synthesis

ReadingMachine is a computational methodology for structured corpus reading that uses large language models to perform bounded reading operations over entire document collections. Rather than relying on retrieval or recursive summarization, the approach decomposes analysis into inspectable stages including insight extr...

James Morrissey · 0 citations
#natural language process... Preprint Open access Sep 2026

FinEvolveBench: A Benchmark for Self-Evolving Agents on Low-Repetition Tasks with Implicit Rewards

Large language model (LLM) agents increasingly rely on external experience to continually adapt to changing environments without modifying their underlying models. Recent experience mechanisms have demonstrated promising results across diverse tasks. However, their effectiveness is typically evaluated within individual...

Yining Zhu, Zihao Deng, Leiming Wang et al. · 0 citations

From tech blogs

See all →
MIT News · Artificial Intelligence Oct 15, 2026

AI model decodes the language cells use to communicate

A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.

Microsoft Research Blog Oct 15, 2026

Proof-based general-purpose computing with Magnetar

Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.

MIT News · Artificial Intelligence Sep 24, 2026

Estimating suicide risk from text

A new language-processing tool could help identify the highest-risk individuals from natural language, enabling swifter interventions.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.