Skip to content

Category

natural language processing

8,786 papers

#artificial intelligence Preprint Sep 2026

Understanding Confabulation and Rethinking Reconstruction in Activation Explanations

A standardized evaluation framework for unstructured NLA explanations is introduced, measuring information recoverable from explanations, contextual support for their claims, and writing quality, and opening up a direction for improving activation-derived training to encourage more informative, supported, and readable...

Gert Lek, Zi-Xuan Xia, Pin-Yu Chen et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Tsubame: Tree Replay for Diffusion-Based Speculative Decoding

Context-aware dynamic trees allocate the speculative decoding budget according to draft path probabilities, adapting their depth and branching to the current context. Under stochastic decoding, however, we find that this structural advantage does not always compensate for the acceptance gains of random sampling paired...

Yepeng Weng, Qiao Hu, T. Yairi · 0 citations
#artificial intelligence Preprint Sep 2026

Learning to Learn from Context: Synthetic Training from Perturbed Public Documents

This work attempts to make use of high-quality public documents with small perturbations and empirically finds that LLMs can successfully generate context-dependent reasoning traces and answers, which are then used to train a student model that substantially improves the performance on CL-bench.

Hao Wu, Yang Xiao, Yu-Song Sun et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Safety Reconstructed: Generative Modeling via Masked Diffusion Builds Strong Safety Guardrails

This work proposes a masked diffusion language model, fine-tuning LLaDA-8B-Instruct with a class-conditional reconstruction objective using LoRA and requiring no architectural changes beyond the base model, which leads on average rank against discriminative baselines trained on stronger backbones across seven held-out...

Gert Lek, Abele Malan, Chao-Yi Zhu et al. · 0 citations
#artificial intelligence Preprint Sep 2026

E-CONAN (Entailment, CONtradition And Neutral) Diagnostics Dataset Investigating Linguistic Phenomena in Arabic Natural Language Understanding

E-CONAN diagnostics dataset is introduced, a freely available dataset manually-annotated with coarse-grained and fine-grained categories based on the authors' proposed Arabic hierarchy, which helps NLU designers better understand their models by doing error analysis and in-depth investigation.

Khloud Al Jallad, Nada Ghneim, Ghaida Rebdawi · 0 citations
#artificial intelligence Preprint Sep 2026

A Cheap Verifier is Good Enough: LLM Post-training is Robust to Erroneous Rewards

This paper compares two low-cost choices retrospectively -- a cost-reducing choice and a balanced choice -- with estimated grading cost reductions and average post-training score gaps of 1-3 points from the best evaluated training verifier, and establishes that verifier choices are interchangeable.

Andreas Lindhardt Plesner, Curtis G. Northcutt, F. Guzmán et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Decoupling Token Roles in Autoregressive Pretraining

Using controlled corruption, this work decouple these two roles and finds a reversal: making a noisy token easier to predict reduces its damage as a target but increases it as context.

Su-Qin Yuan, Runqi Lin, Ke-Yu Lin et al. · 0 citations
#artificial intelligence Preprint Sep 2026

CHI: A Composite Hallucination Index Unifying Entity, Relation, and Quantity Dimensions for Summarization Evaluation

CHI (Composite Hallucination Index), the first unified hallucination metric that decomposes faithfulness errors into three orthogonal dimensions, provides practitioners with a decomposable, interpretable, and efficient faithfulness metric suitable for both offline evaluation and online monitoring of summarization syste...

Praveenkumar Katwe, R. Balabantaray, Kali Prasad Vittala · 0 citations
#artificial intelligence Preprint Sep 2026

Does Learning to Predict the World Help Agents Act? Auditing World-Model Post-Training

This work replaces true next-observation targets with in-distribution mismatched observations and introduces a setting that replaces prediction-based rewards with independent random signals, which expands task coverage even when the reward carries no environment information.

Xin-Yu Che, Hang Yan, Yan-Chen Liu et al. · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

MIT News · Artificial Intelligence Oct 15, 2026

AI model decodes the language cells use to communicate

A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.

Microsoft Research Blog Oct 15, 2026

Proof-based general-purpose computing with Magnetar

Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.

MIT News · Artificial Intelligence Sep 24, 2026

Estimating suicide risk from text

A new language-processing tool could help identify the highest-risk individuals from natural language, enabling swifter interventions.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.