Skip to content

Category

data science

2,954 papers

#machine learning Open access Dec 2025

Active Learning for Data-Driven Reduced Models of Parametric Differential Systems with Bayesian Operator Inference

This work establishes a probabilistic version of parametric operator inference, casting the learning problem as a Bayesian linear regression, and designs a sequential adaptive sampling scheme to select new training parameter vectors that promote ROM stability and accuracy globally in the parameter domain.

Shane A. Mcquarrie, Meng-Wu Guo, A. Chaudhuri · 1 citation

Reliable Selection of Heterogeneous Treatment Effect Estimators

We study the problem of selecting the best heterogeneous treatment effect (HTE) estimator from a collection of candidates in settings where the treatment effect is fundamentally unobserved. We cast estimator selection as a multiple testing problem and introduce a ground-truth-free procedure based on a cross-fitted, exp...

Jiayi Guo, Zijun Gao · 0 citations

Data-efficient Kernel Methods for Learning Hamiltonian Systems

This work proposes kernel-based methods for identifying and forecasting Hamiltonian systems directly from trajectory data, and provides a more general, problem-agnostic numerical framework that goes beyond Hamiltonian systems and can be used for data-driven learning of arbitrary dynamical systems.

Yasamin Jalalian, Mostafa Samir, B. Hamzi et al. · 4 citations
#machine learning Preprint Apr 2025

Semiparametric Inference for Counterfactual Regression under Intervention-Driven Shift

We study counterfactual regression, which maps features to outcomes under hypothetical scenarios that differ from those observed in the data. This problem is central to decision-making under distribution shift, where treatment patterns may change at deployment. We develop a semiparametric framework for counterfactual r...

Kwangho Kim · 1 citation
#machine learning Preprint Aug 2026

Activation-Keyed Momentum: An Anisotropic Momentum Update via the Delta Rule

Activation-Keyed Momentum (AK-Momentum), which builds direction-awareness into the momentum update rule, is proposed, and it is proved that it is a valid momentum, that it applies the input-side curvature correction without matrix inversion, and that it clears stale directions faster than EMA under both a fixed and a d...

E. Hong, Guan-Nan Qu · 0 citations

SPACR: Single-Pass Adaptive Training of Uncertainty-Aware Conformal Regressors

SPACR (Single-Pass Adaptive Conformal Regressor), a novel method for directly training uncertainty-aware regressors within a differentiable loss, jointly optimizes accuracy, efficiency, and validity without batch-splitting or a predefined confidence level during training.

S. Messoudi, Sylvain Rousseau, Sébastien Destercke · 0 citations

Theoretical Foundations and Effective Algorithms for Policy-Aware Simulator Learning

This work proposes that the objective for learning simulators should be strategic robustness rather than predictive accuracy, and formulate this as a zero-sum minimax game between a model player and an adversarial policy player, which yields a provably convergent active data selection algorithm.

Christoph Dann, Yishay Mansour, M. Mohri · 0 citations
#machine learning Preprint Sep 2026

Cooperative Multi-Task Semantic Communication for Joint Classification and Regression Tasks

This paper extends the cooperative multi-task SemCom framework to jointly handle heterogeneous classification and regression tasks on the complex Cityscapes dataset and adopts the information maximization (InfoMax) principle so that it accommodates mixed discrete and continuous semantic variables.

Ahmad Halimi Razlighi, M. Rahman, Maximilian H. V. Tillmann et al. · 0 citations
#machine learning Preprint Sep 2026

Correlated initialization of deep residual networks

We study the large-depth behavior of residual networks whose weights are correlated across layers at initialization. Our results confirm and extend a conjecture of Marion et al. [2025], according to which correlated initializations should interpolate continuously between the Brownian stochastic differential equation ar...

Felix Benning, I. Nourdin, G. Peccati · 1 citation
#machine learning Preprint Sep 2026

Towards a Statistical Understanding of Mixture-of-Experts

This paper derives oracle risk bounds for learning dense and sparse routing with evolving experts, separating approximation, expert-learning, and router-estimation errors, and characterize how sparse Top-K routing can retain the benefits of localized aggregation while controlling per-input computation.

Si-Yuan He, Bo-Kai Yang, Jie Hu et al. · 0 citations
#machine learning Preprint Sep 2026

ALRA: Adaptive Local Relational Alignment for Logit-Based Pre-training Distillation of Autoregressive Language Models

This work proposes Adaptive Local Relational Alignment (ALRA), a position-specific framework combining student proposals with teacher guidance, which replaces the teacher-mass coefficients of the two conditional terms with unit coefficients, preventing either term from being downweighted solely because its region has l...

Quang Hoang Trung, Quang Huu Hieu, Phuc-Thanh Nguyen et al. · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 15, 2026

Proof-based general-purpose computing with Magnetar

Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.