Skip to content

Category

data science

2,791 papers

#machine learning Preprint Jul 2019

Regularized Estimation and Feature Selection in Mixtures of Generalized Linear Experts

This work proposes a regularized maximum likelihood framework for simultaneous parameter estimation and feature selection in MoE whose experts belong to the generalized linear model family, covering Gaussian, Poisson and multinomial responses within a single formulation.

Thin Nguyen-Van, Faicel Chamroukhi, Ha Hoang Van et al. · 15 citations

Dead Directions: Geometric Singular Learning

The central result recovers the KL order as the decay rate of the directional Fisher quadratic form approaching the singularity, in original coordinates, without a Hironaka resolution.

Tejas Pradeep Shirodkar · 0 citations
#machine learning Preprint Open access Sep 2026

Unbiased and Biased Variance-Reduced Forward-Reflected-Backward Splitting Methods for Stochastic Composite Inclusions

This paper develops new variance-reduction techniques for the forward-reflected-backward splitting (FRBS) method to solve a class of possibly nonmonotone stochastic composite inclusions. Unlike unbiased estimators such as mini-batching, developing stochastic biased variants faces a fundamental technical challenge and h...

Quoc Tran-Dinh, Nghia Nguyen-Trung · 0 citations

Theoretical Analysis of Measure Consistency Regularization for Partially Observed Data

This paper offers theoretical insights into when MCR yields a more favorable finite-sample estimation-error upper bound, viewed through the lens of neural network distance, and proposes a novel practical diagnostic that leverages the duality gap and a calibrated drift estimator to infer the potential benefit of MCR tra...

Yinsong Wang, Shahin Shahrampour · 0 citations
#machine learning Preprint Sep 2026

Optimal Value Inference for Reinforcement Learning

Two new nuisances are derived as fixed points of a self-induced Bellman equation, in which they approximate the maximum Bellman operator by its softmax correspondence, and a debiased estimator is proposed through the Neyman orthogonality and established its asymptotic normality under diverging horizons.

Nan Lu, Ethan Lee, James M. Robins et al. · 0 citations
#machine learning Preprint Sep 2026

A Unifying Perspective on Probabilities as Model Predictions

Although probabilistic statements are ubiquitous, foundational disagreements persist about their understanding, as exemplified by debates between Bayesians and frequentists; moreover, it is unclear when and why acting on them actually leads to desirable outcomes. Here, we argue that every probability is the output of a...

Benedikt Höltgen · 0 citations
#machine learning Preprint Sep 2026

Why Learning Rediscovers the Closed-Form Diagonal Regularizer

We identify a diagonal saturation principle in modal inverse problems: when truncation noise is isotropic, the Bayes-optimal Tikhonov shape is a closed-form power law Gamma_k proportional to lambda_k^|s| set by the prior alone, independent of the domain. Berry's random-wave conjecture decorrelates the truncation noise...

Jeahn Han, Pyojin Kim · 0 citations
#machine learning Preprint Sep 2026

Distillation of Synthetic Data for Time Series Foundation Models

Time series foundation models (TSFMs) are increasingly pre-trained on synthetically generated time series trajectories, where the data generating process is known. Current pre-training recipes are based on loss objectives which compare TSFM outputs to realized future values of each trajectory. We instead propose loss o...

N. Biswas, Noureddine El Karoui · 0 citations
#machine learning Preprint Sep 2026

Oracle Complexity of Stochastic Fixed-Point Equations with Nonexpansive Maps

The lower bound holds against any randomized algorithm that succeeds with constant probability and extends to settings with ``sparse''noise, ruling out the possibility of improving oracle complexity as a function of $\varepsilon$ by measuring variance in a non-matching $\ell_p$ norm.

Jelena Diakonikolas, Cristóbal Guzmán, David Martínez-Rubio · 0 citations
#machine learning Preprint Sep 2026

Gaussian Approximation for Multivariate Martingale Sums from Uniformly Ergodic Markov Chains

We develop Gaussian approximation bounds in higher-order Wasserstein distance $W_p$, $p\geq2$, for sums of multivariate martingale differences generated by a uniformly ergodic Markov chain. Under an $L^{(2+\eta)p}$-moment condition with $\eta>0$, we establish the explicit bound $$ O\left( p^3 \|A\|_4^2 + pd^{1/4}\|A\|_...

Yi-Xuan Zhang, Qiao-Min Xie · 2 citations

From tech blogs

See all →

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.