Skip to content

Category

data science

2,952 papers

#machine learning Preprint Open access Sep 2026

Projected Neural Differential Equations for Learning Constrained Dynamics

Neural differential equations offer a powerful approach for learning dynamical systems from data. However, they do not inherently respect known constraints, such as conservation laws, that should be obeyed by the learned dynamics. It is well known that enforcing constraints in data-driven models can enhance their gener...

Alistair White, Anna B\"uttner, Maximilian Gelbrecht et al. · 0 citations
#machine learning Conference Nov 2023

High-dimensional Linear Bandits with Knapsacks

An online variant of the hard thresholding algorithm that performs the sparse estimation in an online manner is developed and embedded in a primal-dual scheme: every knapsack constraint is paired with a dual variable, which is updated by an online learning rule to keep the cumulative resource consumption within budget.

Wan-Teng Ma, Dong Xia, Jia-Shuo Jiang · 3 citations
#machine learning Open access Oct 2023

Latent class analysis by regularized spectral clustering

Two new algorithms for estimating the parameters of a latent class model for ordered categorical data with polytomous responses are introduced based on a newly defined regularized Laplacian matrix derived from the response matrix.

Huan Qing · 2 citations
#machine learning Preprint Jul 2023

Understanding Uncertainty Sampling via Equivalent Loss

The equivalent loss is introduced, whose gradient is the original loss gradient multiplied by the query probability, which derives a finite-sample excess-risk bound with a fixed learning rate and an explicit constant controlling the tradeoff between initial error and query-weighted gradient variance.

Shang Liu, Xiaocheng Li · 14 citations · ⚡1
#machine learning Preprint Sep 2026

High-Magnetization Sampling at Low Temperatures: Ising Models and Bayesian Sparse Linear Regression

Sparsity is a powerful structural resource in optimization and statistics. We develop frameworks for leveraging sparsity in sampling problems over the Hamming slice $\mathcal{X}_k^d:=\{\mathbf{x}\in\{\pm 1\}^d:|\{i:\mathbf{x}_i=1\}|=k\}$, in high-dimensional regimes where $k\ll d$ (i.e., where $\mathcal{X}_k^d$ is \emp...

Syamantak Kumar, Purnamrita Sarkar, Kevin Tian et al. · 0 citations
#machine learning Preprint Sep 2026

Optimal estimation for Functional Linear Regression with Noisy Discretized Data

In this paper, we consider the scalar-on-function linear regression model under a realistic sampling scheme in which the functional covariates are observed on a regular grid and contaminated by additive noise. We propose a two-step estimation procedure: first, the underlying curves are reconstructed from the discrete n...

Sixtine Sphabmixay · 0 citations
#machine learning Preprint Sep 2026

Non-Adaptive 1-Bit Mean Estimation: Minimax Rates and the Sample-Interval Tradeoff

This work identifies the minimum interval budget needed to retain the unrestricted 1-bit minimax sample rate and determines the minimax sample complexity among non-adaptive 1-bit estimators when every one-set $Q^{-1}(1)$ is restricted to a union of at most $s$ intervals.

Ivan T. Lau, Jonathan Scarlett · 0 citations
#machine learning Preprint Sep 2026

The Exact Time-Uniform Rate Frontier for Stochastic Gradient Descent on Smooth Convex Objectives

We study the time-uniform convergence of the raw iterate of standard stochastic gradient descent (SGD) for unconstrained smooth convex objectives. We prove that, under standard noise assumptions, the time-uniform convergence rate gets arbitrarily close to $\sqrt{\log n / n}$ but never reaches it. More specifically, we...

Rui-Jie Li, Kang Chen, Tian-Yu Wang · 0 citations
#machine learning Preprint Sep 2026

Distribution-free inference on the number of changepoints

Suppose we are given an ordered sequence of independent data whose distribution changes $K$ times at unknown locations, for some unknown $K \geq 0$. In this paper, we study the problem of performing distribution-free inference on $K$. First, we show an impossibility result: any distribution-free upper confidence bound...

Rohan Hore, Aaditya Ramdas · 0 citations
#machine learning Preprint Sep 2026

Speed Limit for Information Acquisition in Stochastic Learning Dynamics

A Fisher-information flow speed limit is derived that bounds the rate at which trainable parameters can acquire information about latent variables in the data-generating process and establishes Fisher-information speed limits as a quantitative framework for diagnosing when and how different aspects of the data-generati...

Shuta Kobayashi, Andreas Dechant · 0 citations
#machine learning Preprint Sep 2026

Optimal Slice-Adaptive Tuning of Hybrid Slice Sampling

Simulations demonstrate that the tuning schemes reliably yield near-optimal slice-adaptive tuning with essentially no dependence on the initial setting of $w$, and develop automated, slice-adaptive tuning schemes along with suboptimality bounds and asymptotic convergence guarantees.

Trevor Campbell · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 15, 2026

Proof-based general-purpose computing with Magnetar

Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.