Skip to content

Category

data science

2,653 papers

#machine learning Preprint Sep 2026

Improving the Predictive Performance of Bootstrap Aggregating by Dirichlet Resampling

We revisit Breiman's observation that reducing inter-tree correlation without weakening individual trees can improve random forests. Building on this principle, we introduce two variants: Dirichlet-Multinomial Bagging Random Forest (DM) and Dirichlet-Weighted Random Forest (DW). Both modulate sample reweighting via a c...

Quoc V. Le, Joon Suk Park · 0 citations
#machine learning Preprint Sep 2026

Brownian Heads for Deep ReLU Representations: Activation Mass and the Cost of Same-Sample Selection

This work studies the conditional empirical Rademacher complexity of deep ReLU representations followed by bounded-norm predictors in additive or L\'evy-Brownian RKHSs, termed Brownian heads, and derives an exact dual identity and sharp bounds in terms of activation mass, the average norm of the observed hidden vectors...

Mahdi Mohammadigohari, Nicole Mücke · 0 citations
#machine learning Preprint Sep 2026

Sparse Identification for Automatic Large-Scale Screening: A Constraint-Aware Framework with Ultra Fast Decoding Algorithm

The Logic Screening method (LoSc) is proposed, an ultra fast, accurate, and theoretically grounded framework for large-scale screening that explicitly incorporates dilution and sample usage constraints into pooling designs, and establishes theoretical guarantees to guide optimal pooling configurations.

Jia-Ning Li, Li Chai, Ying-Cheng Lai · 0 citations
#machine learning Preprint Sep 2026

Triply-Scalable Equivariant Gaussian Process Modeling

A matrix-free equivariant full-GP implementation that combines an exact Kronecker reduction with preconditioned conjugate-gradient solves is developed, enabling fast and scalable evaluation of the full joint predictive density, and triply scalable equivariant Gaussian processes are introduced.

Tim Steinert, David Ginsbourger · 0 citations
#machine learning Preprint Sep 2026

A Smoothed Discrepancy Principle for Random Feature Methods and Neural Networks

We study data-driven early stopping for spectral regularisation methods in the classical non-parametric regression setting. Building on the discrepancy principle, we propose a multi-scale stopping rule that applies to general kernel estimators and show that, unlike previous approaches, it achieves full adaptivity over...

Mike Nguyen, Nicole Mücke · 0 citations
#machine learning Preprint Sep 2026

Aggregated Posterior Predictive Checks for Generative Modeling

Experiments with variational autoencoders show that aggregated posterior sampling improves generation for heavy-tailed and clustered data relative to Gaussian prior sampling while performing comparably to models with more flexible latent priors.

Shweta Dutta, Gemma E. Moran · 0 citations
#machine learning Review Sep 2026

Complex Problem Solving in Large Language Models: A Statistical Control Survey and Diagnostic Framework

This framework organizes existing methods around five components: explicit state representation, transition structuring, validation and constraint enforcement, search and rollback, and uncertainty management, and yields a diagnostic hypothesis: interventions should be most effective when they target the error or uncert...

Jia-Zhang Cai, Tao Wang, Rui-Dong Zhang et al. · 0 citations
#machine learning Preprint Sep 2026

Training-Adaptive Convolutional Sparse Coding via Information Bottleneck for Robust Visual Representation

Visual signals require compact yet sufficient representations for robust downstream prediction. Convolutional sparse coding (CSC) provides an explicit mechanism for suppressing redundant components while preserving signal content, but its sparsity coefficient is often manually selected during training. We propose a tra...

Meng'en Qin, Yin-Chen Liu, Ming-Xuan Cui et al. · 0 citations
#machine learning Preprint Sep 2026

Geometric Mean Pooling for Equal-Weight Multiplicative Coarse-Graining

Geometric Mean Pooling is introduced, a signed pooling operator that combines the product of feature signs with the geometric mean of feature magnitudes and retains both joint sign information and a characteristic multiplicative scale without introducing learnable pooling parameters.

Ang-Kun Wu, Fang-Di Wen, Jing-Tao Zhang · 0 citations
#machine learning Preprint Sep 2026

Multi-Domain Clustering via Measure Quantization

This work presents a general framework for multi-domain clustering via measure quantization: given samples from multiple domains, given samples from multiple domains, they learn a shared set of cluster prototypes by minimizing a probability metric between each domain's probability measure and the measure of prototypes.

Rafael Pereira Eufrazio, Eduardo Fernandes Montesuma, C. C. Cavalcante · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 6, 2026

What AI gets wrong and what failure teaches us

Jennifer Neville did not want to go into computer science—but that’s exactly where she landed. Neville discusses the starts and stops that led to her professional sweet spot and her work identifying “surprising failures” making it hard for AI to handle complexity.  The post What AI gets wrong and what failure teaches us appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.