Skip to content

Category

natural language processing

8,786 papers

#artificial intelligence Preprint Open access Sep 2026

ReScraper: Unified Scraping and Cleaning of Web Data for Effective LLM Pretraining

LLM pretraining corpora are normally cleaned by a stack of hand-written heuristics. A heuristic scraper extracts the main content from HTML, and dozens of rule-based filters then clean it, so corpus quality is capped by the coarseness and accuracy of the rules. In this work, we propose ReScraper, a unified language mod...

Zichun Yu, Jiarui Yan, Shlok Sanghvi et al. · 0 citations
#artificial intelligence Preprint Sep 2026

LLMs are not stochastic parrots: Evidence for meaning-mediated abstraction from conlang-like tasks

The strong version of the stochastic parrot argument claims that, although large language models (LLMs) may exceed rote regurgitation, they cannot move beyond statistical pattern matching into abstraction or reasoning, remaining ontologically near the lower bound of pattern reuse despite producing alluringly fluent tex...

J. Zimmerman, C. Beauregard, Tabia Tanzin Prama et al. · 0 citations
#artificial intelligence Preprint Open access Sep 2026

Toward a Graded Measure of Belief Stability in Large Language Models

Large language models (LLMs) increasingly mediate how people access and reason with information, yet factual reliability is usually evaluated one judgment at a time. We introduce graded belief stability, a relational measure of how well a belief persists within an LLM's broader belief system. Unlike individual belief p...

Samantha Dies, Branden Fitelson, Tina Eliassi-Rad · 0 citations
#artificial intelligence Preprint Sep 2026

Unknown is not normal: separating language-model extraction from rule-based decision logic for clinical risk scores

This work tests whether separating three-state extraction (present, absent or unknown, by an LLM) from decision logic (deterministic code computing score bounds over unknown inputs) lets a system ask only questions that can change the decision.

Nicolás Vera Zúñiga · 0 citations
#artificial intelligence Preprint Sep 2026

Who Gets a Token, and What Does It Carry? Unequal Name Support and Concept Access in Large Language Models

Names are personal identifiers, but they also carry social meaning and are widely used to evaluate how language models treat different people, so it is shown that this assumption often fails at the lexical interface: matched names are not necessarily matched inputs.

Mir Tafseer Nayeem, Davood Rafiei · 0 citations
#artificial intelligence Preprint Sep 2026

On the Token Value Inequality in Efficient Reasoning

This work presents a diagnostic and optimization framework grounded in a key empirical finding: the value of tokens within a CoT reasoning sequence is highly non-uniform, and this non-uniformity can be effectively characterized by token-level log probability signals.

Run-Jia Zeng, Hang Hua, Yiyang Liu et al. · 0 citations
#artificial intelligence Preprint Open access Sep 2026

Quantization Error Is Spectrally Flat: A Single Random Probe Is a Calibrated, Data-Free Sensitivity Estimator, with Application to Budget-Targeted Mixed-Precision Quantization

A single random Gaussian probe gives an unbiased estimate of the squared Frobenius norm of a layer's quantization error. The estimator is well-behaved because round-to-nearest error is spectrally flat. Across 1,683 tensors from a 35B MoE and a 9B dense model, effective dimensionality is 0.93 to 0.96 times the i.i.d. no...

I Kennedy, T Kennedy · 0 citations
#artificial intelligence Preprint Sep 2026

Program-Verified Self-Evolution for Vision-Language Models

Verifiable QA Generation for Self-Evolving Models (VQS) is presented, which changes how the model judges answers and improves Qwen3-VL by up to 3.18 points at the 2B, 4B, and 8B scales and outperforms the strongest self-evolving baseline at each.

Ahmed Heakl, Sungik Choi, Moontae Lee et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Surprising Success, Repeated Failure: Entropy-Guided Credit Assignment for Exploration in LLM Reasoning

Entropic Advantage Policy Optimization (EAPO) is introduced, an entropy-guided credit assignment method that treats success and failure asymmetrically and promotes more effective exploration, broadening problem coverage and generating more diverse candidate answers.

Woongyeong Yeo, Minki Kang, Chanuk Lee et al. · 0 citations
#artificial intelligence Preprint Sep 2026

BOReFT: Manifold Steering of Language Models for Black-box Optimization

BOReFT is introduced, which learns a compact, low-dimensional space of hidden-state interventions in a frozen language model, and uses this space as the search domain for Bayesian optimization with an external scoring function, and provides a principled new bridge between discrete proposal spaces of LLM-based search an...

Dhruv Agarwal, Rico Angell, Kavitha Srinivas et al. · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

MIT News · Artificial Intelligence Oct 15, 2026

AI model decodes the language cells use to communicate

A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.

Microsoft Research Blog Oct 15, 2026

Proof-based general-purpose computing with Magnetar

Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.

MIT News · Artificial Intelligence Sep 24, 2026

Estimating suicide risk from text

A new language-processing tool could help identify the highest-risk individuals from natural language, enabling swifter interventions.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.