Skip to content

Category

data science

2,952 papers

#machine learning Preprint Open access Sep 2026

Linear and Quadratic Discriminant Analysis: Tutorial

This tutorial explains Linear Discriminant Analysis (LDA) and Quadratic Discriminant Analysis (QDA) as two fundamental classification methods in statistical and probabilistic learning. We start with the optimization of decision boundary on which the posteriors are equal. Then, LDA and QDA are derived for binary and mul...

Benyamin Ghojogh, Mark Crowley · 0 citations
#machine learning Preprint Aug 2026

K\"ahler landscapes for complex neural network descents and guarantees including a search and destroy of the Calabi-Yau manifold

It has been discovered that negative curvature subverts the loss landscape, specifically sectional curvature, so it has been discovered that negative curvature subverts the loss landscape, so this work expands on this and draw interconnections to negative-definite Ricci curvature.

Andrew Gracyk · 0 citations
#machine learning Preprint Aug 2026

ArborEnum: Decision Tree Rashomon Sets over Continuous Features

This work introduces the first algorithm that exactly enumerates decision-tree Rashomon sets while exploiting the ordered structure of continuous features, and develops a relaxation for approximate enumeration and an anytime algorithm that progressively refines the set of candidate thresholds, producing increasingly de...

Zakk Heile, Hayden McTavish, Margo I. Seltzer et al. · 0 citations
#machine learning Preprint Aug 2026

Noise in Diffusion Models Is a Learnable Input

The results indicate that diffusion noise is not merely a passive stochastic perturbation, but a learnable---and therefore potentially designable---input dimension.

Shengzhi Deng, Chenqi Ye, Yan-Ze Guo · 0 citations
#machine learning Preprint Open access Sep 2026

Vocabulary-size-independent Convergence of Discrete Diffusion Models: adjoint equations induce the right space

Discrete diffusion has become a leading framework for generative modeling in various applications including language, vision, and biology. Existing convergence theory, however, exhibits fundamental limitations. KL-based analyses diverge under singular priors such as the masked distribution, while bounds in total variat...

Kelvin Kan, Xingjian Li, Benjamin J. Zhang et al. · 0 citations

Improved Dimension Dependence for Bandit Convex Optimization with Gradient Variations

This work proposes a refined analysis of the non-consecutive gradient variation, a fundamental quantity in gradient variation with bandit feedback, and improves the dimension dependence for both convex and strongly convex functions compared with the best known results.

Hang Yu, Yu-Hu Yan, Peng Zhao · 7 citations
#machine learning Preprint Open access Sep 2026

Low-Rank Plus Sparse Matrix Transfer Learning under Growing Representations and Ambient Dimensions

Learning systems often expand their ambient features or latent representations over time, embedding earlier representations into larger spaces with limited new latent structure. We study transfer learning for structured matrix estimation under simultaneous growth of the ambient dimension and the intrinsic representatio...

Jinhang Chai, Xuyuan Liu, Elynn Chen et al. · 0 citations
#machine learning Open access Aug 2025

Comparison of D-Wave Quantum Annealing and Gibbs Monte Carlo for Sampling from a Probability Distribution of a Restricted Boltzmann Machine

A local-valley (LV)-centered approach to assessing the quality of sampling from Restricted Boltzmann Machines (RBMs) was applied to the latest generation of the D-Wave quantum annealer, revealing some potential for improvement, e.g., using a combined classical–quantum approach.

Abdelmoula El Yazizi, S. U. Khan, Y. Koshka · 1 citation
#machine learning Preprint Open access Sep 2026

Learning Latent Graph Geometry via Fixed-Point Schr\"odinger-Type Activation: A Theoretical Study

We study neural architectures in which each hidden layer is defined by the stationary state of a dissipative Schr\"odinger-type dynamics on a learned latent graph. On stable branches, the local stationary problem defines a differentiable implicit graph layer. To learn the graph itself, we optimize over the stratified m...

Dmitry Pasechnyuk-Vilensky, Martin Tak\'a\v{c} · 0 citations
#machine learning Preprint Open access Sep 2026

A Review of the Long Horizon Forecasting Problem in Time Series Analysis

The long horizon forecasting (LHF) problem has come up in the time series literature for over the last 35 years or so. This review covers aspects of LHF in this period and how deep learning has incorporated variants of trend, seasonality, fourier and wavelet transforms, misspecification bias reduction and bandpass filt...

Hans Krupakar, Kandappan V A · 0 citations
#machine learning Preprint Apr 2025

The Dynamics of Generalization in Deep Learning

This work derives a differential equation that governs the evolution of the generalization gap when a model is trained by gradient descent-based methods and shows that the generalization gap is given by a quadratic form that consists of an ``effective Gram matrix'' that depends upon the training trajectory and a certai...

Ru-Bing Yang, Pratik Chaudhari · 3 citations

From tech blogs

See all →
Microsoft Research Blog Oct 15, 2026

Proof-based general-purpose computing with Magnetar

Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.