Skip to content

Category

machine learning

14,746 papers

#machine learning Preprint Open access Oct 2026

Bayesian Nonparametric Mixed-Effect ODEs with Gaussian Processes

Dynamical modelling in pharmacometrics, systems biology, and epidemiology often involves subjects with related but distinct dynamics, observed through temporally sparse and irregular measurements. Classical nonlinear mixed-effects ODE models represent this heterogeneity but rely on parametric vector fields, making them...

Julien Martinelli, Maksim Sinelnikov, Harri L\"ahdesm\"aki et al. · 0 citations
#machine learning Preprint Open access Oct 2026

On the Approximation Complexity of Matrix Product Operator (MPO) Born Machines

Matrix product operator Born machines (MPO-BMs) are tractable tensor-network models for probabilistic modeling, yet their approximation capabilities remain poorly understood in theory. In this paper, we characterize these capabilities from both negative and positive perspectives. As a negative result, we prove that con...

Chao Li, Zerui Tao, Yuchen Cong et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Model Capacity Determines Grokking through Competing Memorisation and Generalisation Speeds

Existing accounts of grokking explain the phenomena in terms of mechanistic frameworks such as circuit efficiency or lazy-to-rich transitions. However, despite a known dependence between grokking and model size, how model capacity shapes grokking remains an open question. We give an information-theoretic account of thi...

Yiding Song, Hanming Ye · 0 citations
#machine learning Preprint Open access Oct 2026

Reinforcement learning for inverse silhouette design and rapid laser cutting of compact parallelogram quad kirigami prototypes

Kirigami is an increasingly useful fabrication method to produce shape-programmable metamaterial structures. However, inverse design remains difficult because deployment is nonlinear, and feasible cut layouts must satisfy discrete compatibility rules, avoid overlap, and map one target shape to valid designs. We present...

Milad Yazdani, Shahriar Shalileh, Dena Shahriari · 0 citations
#machine learning Preprint Open access Oct 2026

Constrained Triple-Head Price Optimization (C3PO) Network for Discrete-Choice Models

We propose a Constrained Triple-Head Price Optimization (C3PO) network for real-time bi-level decision making in discrete-choice environments. In these settings, a seller selects product or service offerings to achieve business objectives, while heterogeneous users make personalized acceptance or rejection decisions ba...

Shivaram Subramanian, Zhengliang Xue, Markus Ettl et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Playing the network backward: A Game Theoretic Attribution Framework

Attribution methods explain which input features drive a model's prediction, making them central to model debugging and mechanistic interpretability. Yet backward attribution methods, including gradients, LRP, and transformer-specific rules, lack a shared framework in which to compare the underlying backward calculatio...

Jakob Paul Zimmermann, Jim Berend, Georg Loho et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Approximating Uniform Random Rotations by Two-Stage Structured Hadamard Rotations in High Dimensions

Uniform random rotations are useful in fast Johnson--Lindenstrauss embeddings, kernel approximation, communication-efficient learning, and recent AI compression pipelines, but are computationally expensive to generate and apply in high dimensions. A practical alternative repeats Walsh--Hadamard transforms with random s...

Tomer Zilca, Gal Mendelson · 0 citations
#machine learning Preprint Open access Oct 2026

Koopman-Based Nonlinear Identification and Model Predictive Control of a Turbofan Engine

This paper investigates Koopman operator-based approaches for multivariable control of a two-spool turbofan engine. A physics-based component-level model is developed to generate training data and validate the controllers. A meta-heuristic extended dynamic mode decomposition is adapted, with a cost function designed to...

David Grasev · 0 citations
#machine learning Preprint Open access Oct 2026

Weight Clustering Reveals the Importance of Relative Rank in Large Language Models

Large language models (LLMs) contain billions of parameters, but many exact weight values are not essential. We apply scalar $K$-means clustering to pretrained models, replacing each weight matrix with only 16--64 shared values. For Llama~3.1-8B-Instruct and SmolLM2-135M, this preserves strong accuracy without retraini...

Borja Aizpurua, Sukhbinder Singh, Rom\'an Or\'us · 0 citations
#machine learning Preprint Open access Oct 2026

Bridge Matching Sampler: Scalable Sampling via Generalized Fixed-Point Diffusion Matching

Sampling from unnormalized densities using diffusion models has emerged as a powerful paradigm. However, while recent approaches that use least-squares `matching' objectives have improved scalability, they often necessitate significant trade-offs, such as restricting prior distributions or relying on unstable optimizat...

Denis Blessing, Lorenz Richter, Julius Berner et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Federated Learning of Nonlinear Temporal Dynamics with Graph Attention-based Cross-Client Interpretability

Networks of modern industrial systems are increasingly monitored by distributed sensors, where each system comprises multiple subsystems that generate high-dimensional time-series. These subsystems are often interdependent, making it important to understand how temporal patterns observed at one subsystem relate to thos...

Ayse Tursucular, Ayush Mohanty, Nazal Mohamed et al. · 0 citations
#machine learning Preprint Open access Oct 2026

ERIS: Enhancing the Privacy-Utility-Scalability Trade-Off in Federated Learning via Federated Shard Aggregation

Scaling Federated Learning (FL) to billion-parameter models forces a challenging trade-off between privacy, scalability, and model utility. Existing solutions often tackle these challenges in isolation, sacrificing accuracy, relying on costly cryptographic tools, or introducing communication and optimization inefficien...

Dario Fenoglio, Pasquale Polverino, Akash Dhasade et al. · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 12, 2026

Simulating student learning for better AI tutoring

StudentSim is a research system for evaluating and improving AI tutoring tools before they are tested with learners. It models how individuals may engage with tutors, giving feedback to improve tutor performance across subjects like chess, writing, and mathematics. The post Simulating student learning for better AI tutoring appeared first on Microsoft Research.

MIT News · Artificial Intelligence Oct 7, 2026

Discovering the value of humanistic inquiry

Students in MIT’s Concourse program delve deeply into the human condition, debate challenging questions, and learn to develop judgment about issues that can’t be quantified.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.