Skip to content

Category

data science

2,653 papers

#machine learning Preprint Open access Sep 2026

Dropout Neural Network Training Viewed from a Percolation Perspective

In this work, we investigate the existence and effect of percolation in training deep Neural Networks (NNs) with dropout. Dropout methods are regularisation techniques for training NNs, first introduced by G. Hinton et al. (2012). These methods temporarily remove connections in the NN, randomly at each stage of trainin...

Finley Devlin, Jaron Sanders · 0 citations
#artificial intelligence Preprint Open access Sep 2026

SPID: Distilled Protein Backbone Generation

Diffusion- and flow-based generative models have recently demonstrated strong performance in protein backbone generation tasks, offering unprecedented capabilities for de novo protein design. However, despite their generation quality, these models are constrained by slow sampling, often requiring hundreds of iterative...

Liyang Xie, Haoran Zhang, Zhendong Wang et al. · 0 citations
#machine learning Preprint Open access Sep 2026

RESIST: Resilient Decentralized Learning Using Consensus Gradient Descent

Empirical risk minimization (ERM) is a cornerstone of modern machine learning. This paper focuses on the man-in-the-middle (MITM) attack, wherein adversaries exploit communication vulnerabilities between devices to inject malicious updates during training. To address this challenge, we propose RESIST (Resilient dEcentr...

Cheng Fang, Rishabh Dixit, Waheed U. Bajwa et al. · 0 citations
#artificial intelligence Preprint Open access Sep 2026

Optimal Symmetries in Binary Classification

We develop a theoretical foundation for designing group-equivariant neural networks that align the choice of symmetries with the underlying probability distributions of the data. Utilising the general structure of fibre decompositions on the domain under group equivariant maps and its relation to that of the likelihood...

Vishal S. Ngairangbam, Michael Spannowsky · 0 citations
#artificial intelligence Preprint Open access Sep 2026

Reflective Policy Optimization

On-policy reinforcement learning methods, like Trust Region Policy Optimization (TRPO) and Proximal Policy Optimization (PPO), often demand extensive data per update, leading to sample inefficiency. This paper introduces Reflective Policy Optimization (RPO), a novel on-policy extension that amalgamates past and future...

Yaozhong Gan, Renye Yan, Zhe Wu et al. · 0 citations
#machine learning Preprint Open access Sep 2026

Optimal Sample Complexity of Stable Discounted Markov Decision Processes

We study the optimal sample complexity of tabular reinforcement learning for infinite-horizon discounted Markov decision processes. The unrestricted minimax sample complexity is known to scale as $\widetilde\Theta((1-\gamma)^{-3}\epsilon^{-2})$, where $\gamma$ denotes the discount factor and $\epsilon$ is the solution-...

Shengbo Wang, Jose Blanchet, Peter Glynn · 0 citations
#machine learning Preprint Open access Sep 2026

Distribution-Free Uncertainty Quantification for Kernel Methods by Gradient Perturbations

We propose a data-driven approach to quantify the uncertainty of models constructed by kernel methods. Our approach minimizes the needed distributional assumptions, hence, instead of working with, for example, Gaussian processes or exponential families, it only requires knowledge about some mild regularity of the measu...

Bal\'azs Csan\'ad Cs\'aji, Kriszti\'an Bal\'azs Kis · 0 citations
#machine learning Preprint Open access Sep 2026

JAREX: An Acquisition Function for Multi-Objective Algorithmic Process Characterization

Pharmaceutical process characterization is central to Quality by Design because it defines how variations in process parameters affect the ability to meet product quality specifications, thereby supporting proven acceptable ranges and robust manufacturing. In practice, however, characterization still relies largely on...

Xinyang Li, Kevin Stone, Ajit Vikram · 0 citations
#machine learning Preprint Sep 2026

Conformalized Quantile Regression and Minimax Limits of Fixed-Score Calibration under Known Covariate Shift

In this paper, we study nonasymptotic $L^p$ error bounds for interval length and conditional coverage in split conformalized quantile regression (CQR). Our bounds rely on local regularity conditions and accuracy guarantees for the estimated quantiles. We further instantiate our bounds for quantile regression with spars...

R. Isaev, Anton Conrad, D. Belomestny et al. · 0 citations
#machine learning Preprint Sep 2026

Identifying Representational Biases in Datasets Using PCA: A Max-Disparity Partition Framework

A greedy local-search algorithm is proposed, grounded in the Fiduccia-Mattheyses bipartitioning framework, that discovers the disparity-maximising partition without any predefined group labels and is passed directly to Fair PCA, completing a detect-explain-mitigate pipeline.

K. Arjun, Shashi Jain · 0 citations
#machine learning Preprint Sep 2026

Beyond Point Prediction: Artificial Representative Trees with Uncertainty

Artificial representative trees with leaf-wise Mondrian conformal predictive systems provides a single, interpretable, and stable model for continuous predictions and calibrated probabilities, balancing predictive performance with reproducibility and transparency in settings where stability and interpretability are ess...

Lea L. Mairhöfer, Silke Szymczak, Björn-Hergen Laabs et al. · 0 citations
#machine learning Preprint Sep 2026

Adversarially Robust PAC Learning with Optimal VC Rates

We study the problem of \emph{adversarially robust} PAC learning. In this framework, the learner observes independent samples from an unknown distribution over $\mathcal{X} \times \{0,1\}$, as in classical PAC learning. However, given a perturbation map $\mathcal{U} : \mathcal{X} \to 2^{\mathcal{X}}$ known to the learn...

Steve Hanneke, Amirreza Shaeiri · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 6, 2026

What AI gets wrong and what failure teaches us

Jennifer Neville did not want to go into computer science—but that’s exactly where she landed. Neville discusses the starts and stops that led to her professional sweet spot and her work identifying “surprising failures” making it hard for AI to handle complexity.  The post What AI gets wrong and what failure teaches us appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.