Skip to content

Category

machine learning

15,964 papers

#machine learning Preprint Open access Oct 2026

Do Deep Ensembles Actually Capture Uncertainty in Graph Neural Networks?

While deep ensembles are widely considered to be the default method for uncertainty quantification in deep learning, their effectiveness for graph-structured data is often simply assumed based on successes in domains like computer vision. We investigate standard deep ensembles specifically for message-passing graph neu...

Pedro C. Vieira, Viacheslav Borovitskiy, Pedro Ribeiro · 0 citations
#machine learning Preprint Open access Oct 2026

SURF: Steering the Scalarization Weight to Uniformly Traverse the Pareto Front

Scalarization is widely used in multi-objective optimization owing to its simplicity and scalability. In many applications, the goal is to generate solutions that represent diverse user preferences, ideally with uniform coverage of the Pareto front (PF). However, uniformly sampling scalarization weights usually induces...

Liuyuan Jiang, Chentong Huang, Lisha Chen · 0 citations
#machine learning Preprint Open access Oct 2026

Quadratic Characterizations for Reachability Analysis of Neural Networks

Quadratic constraints (QCs) are widely used to characterize nonlinearities and uncertainties, but generic analytical characterizations can be conservative on bounded domains. This paper develops a framework for constructing verified quadratic characterizations of scalar relations in the two-dimensional real plane. Cand...

Elias Khalife, Mazen Farhood, Pierre-Loic Garoche · 0 citations
#machine learning Preprint Open access Oct 2026

Bayesian Nonparametric Mixed-Effect ODEs with Gaussian Processes

Dynamical modelling in pharmacometrics, systems biology, and epidemiology often involves subjects with related but distinct dynamics, observed through temporally sparse and irregular measurements. Classical nonlinear mixed-effects ODE models represent this heterogeneity but rely on parametric vector fields, making them...

Julien Martinelli, Maksim Sinelnikov, Harri L\"ahdesm\"aki et al. · 0 citations
#machine learning Preprint Open access Oct 2026

On the Approximation Complexity of Matrix Product Operator (MPO) Born Machines

Matrix product operator Born machines (MPO-BMs) are tractable tensor-network models for probabilistic modeling, yet their approximation capabilities remain poorly understood in theory. In this paper, we characterize these capabilities from both negative and positive perspectives. As a negative result, we prove that con...

Chao Li, Zerui Tao, Yuchen Cong et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Model Capacity Determines Grokking through Competing Memorisation and Generalisation Speeds

Existing accounts of grokking explain the phenomena in terms of mechanistic frameworks such as circuit efficiency or lazy-to-rich transitions. However, despite a known dependence between grokking and model size, how model capacity shapes grokking remains an open question. We give an information-theoretic account of thi...

Yiding Song, Hanming Ye · 0 citations
#machine learning Preprint Open access Oct 2026

Reinforcement learning for inverse silhouette design and rapid laser cutting of compact parallelogram quad kirigami prototypes

Kirigami is an increasingly useful fabrication method to produce shape-programmable metamaterial structures. However, inverse design remains difficult because deployment is nonlinear, and feasible cut layouts must satisfy discrete compatibility rules, avoid overlap, and map one target shape to valid designs. We present...

Milad Yazdani, Shahriar Shalileh, Dena Shahriari · 0 citations
#machine learning Preprint Open access Oct 2026

Constrained Triple-Head Price Optimization (C3PO) Network for Discrete-Choice Models

We propose a Constrained Triple-Head Price Optimization (C3PO) network for real-time bi-level decision making in discrete-choice environments. In these settings, a seller selects product or service offerings to achieve business objectives, while heterogeneous users make personalized acceptance or rejection decisions ba...

Shivaram Subramanian, Zhengliang Xue, Markus Ettl et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Playing the network backward: A Game Theoretic Attribution Framework

Attribution methods explain which input features drive a model's prediction, making them central to model debugging and mechanistic interpretability. Yet backward attribution methods, including gradients, LRP, and transformer-specific rules, lack a shared framework in which to compare the underlying backward calculatio...

Jakob Paul Zimmermann, Jim Berend, Georg Loho et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Approximating Uniform Random Rotations by Two-Stage Structured Hadamard Rotations in High Dimensions

Uniform random rotations are useful in fast Johnson--Lindenstrauss embeddings, kernel approximation, communication-efficient learning, and recent AI compression pipelines, but are computationally expensive to generate and apply in high dimensions. A practical alternative repeats Walsh--Hadamard transforms with random s...

Tomer Zilca, Gal Mendelson · 0 citations
#machine learning Preprint Open access Oct 2026

Koopman-Based Nonlinear Identification and Model Predictive Control of a Turbofan Engine

This paper investigates Koopman operator-based approaches for multivariable control of a two-spool turbofan engine. A physics-based component-level model is developed to generate training data and validate the controllers. A meta-heuristic extended dynamic mode decomposition is adapted, with a cost function designed to...

David Grasev · 0 citations
#machine learning Preprint Open access Oct 2026

Weight Clustering Reveals the Importance of Relative Rank in Large Language Models

Large language models (LLMs) contain billions of parameters, but many exact weight values are not essential. We apply scalar $K$-means clustering to pretrained models, replacing each weight matrix with only 16--64 shared values. For Llama~3.1-8B-Instruct and SmolLM2-135M, this preserves strong accuracy without retraini...

Borja Aizpurua, Sukhbinder Singh, Rom\'an Or\'us · 0 citations

From tech blogs

See all →
MIT News · Artificial Intelligence Oct 28, 2026

Making machines that can listen

Professor Paris Smaragdis develops computers with superhuman hearing for applications like speech recognition, music understanding, and environmental monitoring.

MIT News · Artificial Intelligence Oct 23, 2026

Q&A: How AI came to model the “messy” human mind

Assistant Professor Benjamin Lindquist studies how engineers deliberately injected randomness into early AI, giving rise to deep-learning models that sometimes hallucinate.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.