Skip to content

Category

natural language processing

9,261 papers

#artificial intelligence Preprint Aug 2026

Multiple latent orderings better predict language model preferences

It is shown that observed inconsistencies cannot be explained by a single ordering under any monotone link function, and a noise-augmented mixture Bradley-Terry model is introduced that infers latent preference components from repeated pairwise comparisons, suggesting that LLMs reflect plural preferences.

Aviral Chawla, William H. W. Thompson, Jean-Gabriel Young · 0 citations
#machine learning Preprint Aug 2026

PAGE: Partition-Aware Gated KV-Cache Eviction

KV-cache eviction can do more than compress. In long-context LLMs, keeping only some cached tokens sometimes matches or exceeds full-cache accuracy, because many redundant prefill tokens otherwise dilute attention away from the tokens that carry the answer. This benefit is not uniform, and evicting the wrong tokens can...

Pankaj Kumar, Subhankar Mishra · 0 citations
#machine learning Preprint Aug 2026

GRRR: The Geometry of Reshaping, Rotation, and Routing in Decoder LLM post-training

It is found that removing the diagonal component usually preserves most of the gains from post-training, suggesting that post-training gains are carried primarily by reconfiguring and extending pretrained pathways rather than by substantially changing singular values of pre-trained models.

Jia-Ning Qi, Hao Tang, Zhi-Gang Zhu · 0 citations
#machine learning Preprint Aug 2026

Weak Ties, Strong Signals: Efficient Training Data Detection in Diffusion LLMs via Independent Token Sampling

ITS is proposed, a query-efficient framework that uses an attention-derived pairwise dependency proxy to approximate the CMI-aware selection criterion and incorporates a diversity-promoting strategy to improve token coverage across sampling rounds, yielding aggregated token-wise signals that are less affected by depend...

Hong-Yao Yu, Tian-Qu Zhuang, Zi-Yuan Xu et al. · 0 citations
#machine learning Preprint Open access Sep 2026

Success Leaves Detours: Learning Executable Walkthroughs for Long-Horizon Agents

Test-time self-evolving agents improve by reusing past experience, yet sparse-reward trajectories contain failures, loops, and detours, while summaries often omit the state conditions and action dependencies needed for execution. We study executable Walkthrough induction from sparse-reward trajectories: extracting comp...

Kaijie Chen, Chenyu Fang, Liang Yan et al. · 0 citations
#machine learning Preprint Aug 2026

Fusion Anything: A Generalized Multimodal Foundation Model

The Fusion Anything Model (FAM) is proposed, a foundation model for generalized multimodal data fusion that encodes transferable multimodal correlations during training and activates appropriate associations through in-context examples during inference.

Hui-Zi Cui, Zong-Bo Han, Chen Ding et al. · 0 citations
#natural language process... Preprint Open access Sep 2026

Measuring Digital Labour Market Transitions with a Digital Semantic Score: An AI-Based Methodology Applied to the Dutch Labour Market

The digital transformation of the Dutch labour market is reshaping occupational language, career pathways, and job-related skills. Addressing these changes requires granular labour market intelligence. This paper develops an AI-based methodology to analyse digitalisation using data covering millions of Dutch job profil...

Sadegh Shahmohammadi, Xavier Pinho, Mairi Bowdler et al. · 0 citations
#natural language process... Preprint Open access Sep 2026

Wiktionary as a Crowdsourced Lexicon for English Dialects

This paper evaluates Wiktionary as an ethically crowdsourced lexicon for English dialects. We took a two-phase approach, providing an in-depth descriptive analysis of the crowdsourced lexicon for 12 national varieties of English before applying the lexicon to geo-referenced, country-level social media language data to...

Sidney Wong · 0 citations
#natural language process... Preprint Jun 2026

MemAudit: Auditing Long-Term Agent Memory via Hidden User-State Recovery

MEMPROBE is the first benchmark to study memory recovery directly, reconstructing the user state a system retains and scoring it against ground truth, and is seen as a step toward an environment where agents are trained to remember their users, growing more faithful the longer they know them.

En-Ze Ma, Yufan Zhou, Wei-Chieh Huang et al. · 4 citations

Draft-OPD: On-Policy Distillation for Speculative Draft Models

Draft-OPD, which uses target-assisted rollout for stable continuations and replays drafting from the verification-exposed error positions, allowing the drafter to learn from target feedback on both accepted and rejected proposals, focusing on the draft-induced errors that limit speculative acceptance.

Hao Lei, Ya-Fu Li, Haoran Zhang et al. · 10 citations · ⚡1
#natural language process... Preprint May 2026

Sometin Beta Pass Notin: Improving Multilingual ASR for Nigerian Languages via Knowledge Distillation

Sometin Beta Pass Notin is introduced, a multilingual foundational ASR model that covers Yor\`ub\'a, Hausa, Igbo, Nigerian Pidgin, and Nigerian English, and outperform state-of-the-art multilingual models across major benchmarks, including Common Voice and FLEURS.

Sewade Ogun · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

MIT News · Artificial Intelligence Oct 15, 2026

AI model decodes the language cells use to communicate

A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.

Microsoft Research Blog Oct 15, 2026

Proof-based general-purpose computing with Magnetar

Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.