Skip to content

Category

data science

2,654 papers

#machine learning Preprint Sep 2026

ReLU Neural Network Approximation to Smooth Functional Operator: Dimensional Decay and Error Analysis

We study the uniform approximation of smooth scalar-valued functionals on an infinite-dimensional separable Hilbert space by deep ReLU neural networks. Writing the functional input as $X(t)=\sum_{d\geq1}\xi_d\nu_d(t)$, we quantify the importance of coordinate $d$ through $w_ds_d$, where $s_d$ bounds the magnitude of th...

Shu-Hao Jiao · 0 citations
#machine learning Preprint Sep 2026

Conformal Individual Treatment Effect Estimation under Networked Interference

Conformal counterfactual prediction constructs prediction sets with finite-sample coverage guarantees for counterfactual outcomes and individual treatment effects under the no-interference assumption. In this work, we relax this assumption by allowing each unit's potential outcomes to depend on other units'treatments a...

Matteo Zecchin, Osvaldo Simeone · 0 citations
#machine learning Preprint Sep 2026

Data Attribution via Sketched Metadifferentiation

Two algorithms, MAGE and SPELL, suited for reconstruction and attribution respectively, are presented, that run on existing metagradient machinery at no extra cost and demonstrate strong performance over existing baselines across training scales and measurement budgets.

Yu-Xi Chen, Hamza Golubovic, Han Tong et al. · 0 citations
#machine learning Preprint Sep 2026

Steady-State Convergence of Stochastic Approximation

For constant-stepsize stochastic approximation (SA), the iterates converge in distribution to a stationary law that depends on the stepsize $\alpha.$ Steady-state convergence (SSC) concerns the limit of the scaled stationary distribution as $\alpha \downarrow 0.$ Existing SSC theory requires i.i.d. or additive noise an...

Yi-Xuan Zhang, Qiao-Min Xie · 1 citation
#machine learning Preprint Sep 2026

Shapley Value Estimation for Multi-Site Data with Blockwise-Missing Features

FUSHAP is proposed, a method that leverages partially-observed auxiliary sites to reduce the variance of a preliminary single-site Shapley estimate without imputation and reduces MSE on multi-site air quality and multi-center clinical data.

Siqi Li, Wang-Xuan Fan, Yi-Ming Li et al. · 0 citations
#machine learning Preprint Open access Sep 2026

A Functional SVD Framework for Regularized Multivariate Functional PCA with Dual Penalization

This paper introduces a novel framework for Regularized Multivariate Functional Principal Component Analysis (ReMFPCA) via Functional Singular Value Decomposition (SVD). The proposed method extends existing MFPCA approaches by incorporating a generalized functional SVD within a Hilbert space framework, enabling simulta...

Yue Zhao, Hossein Haghbin, Rebecca Sanders et al. · 0 citations
#machine learning Preprint Sep 2026

From matrix inversion to constraints: provably tighter confidence regions for importance weights in label shift

This work proposes a paradigm shift from inversion-based inference to a direct matrix constraint framework, which is used to define a joint confidence region and extract marginal intervals via linear programming, deriving provably tighter bounds for importance weights while maintaining exact finite-sample validity.

Mu-Shan Li, Kihyun Han, Yan-Yuan Ma · 0 citations
#machine learning Preprint Sep 2026

Evaluation of optimisation and Bayesian inference methods for reaction rates in atmospheric chemical mechanisms

Constraining reaction rate coefficients is a central challenge in the development of explicit atmospheric chemical mechanisms, particularly for autoxidation systems where many reaction pathways are only indirectly observed through high-resolution mass spectrometry. In this study, we evaluate rate-coefficient optimisati...

Valery Ashu, W. Peng, Zhi-Song Liu et al. · 0 citations
#machine learning Preprint Sep 2026

Multi-source conformal prediction: leveraging heterogeneity via localization

Multi-Source Randomly Localized Conformal Prediction is proposed, which builds on the local coverage properties of randomly localized conformal prediction and extends it to multiple sources through data-adaptive source selection and establishes finite-sample coverage bounds using an interpretable notion of envelope dis...

Rohan Hore, Anirban Chatterjee, Sayantan Choudhury · 0 citations
#machine learning Preprint Sep 2026

Riemannian ascent--descent for nonconvex nonconcave minimax landscapes: convergence to basin saddle points and applications to distributionally robust optimization

It is proved that an alternating Riemannian gradient scheme converges to a basin saddle point of the penalized DRO problem, recovering the linear and polynomial rates of the abstract theory with all constants explicit in terms of data dimension, loss moments, and the reference covariance.

Rishabh Dixit, Pranav Upadrashta, Alexander Cloninger · 0 citations
#machine learning Preprint Sep 2026

Exact Finite Attention Responses From RoPE Derivatives

We derive exact local responses for attention interventions, allowing candidate edits to be scored from a cached baseline and one backward pass. The starting point is the RoPE derivative $\partial_p z(p) = A z(p)$: its integral gives the finite positional displacement, which we carry through the softmax without lineari...

Julie Huang, Maggie Chlon, G. Gutin et al. · 0 citations
#machine learning Preprint Open access Sep 2026

Just add noise: Debiasing tree-based variable importance in mixed data

Variable importance scores from tree-based methods such as random forests favor continuous predictors over categorical ones. We present a theoretical analysis of this bias and propose a simple remedy: add a small amount of noise to each categorical predictor. The correction is demonstrated on a variety of simulated and...

Jiahe Li, Omar Melikechi · 0 citations

From tech blogs

See all →

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.