Skip to content

Category

machine learning

14,353 papers

#machine learning Preprint Open access Oct 2026

Reinforcement Learning via Fixed-point Flow Matching

In maximum entropy and behavior-constrained reinforcement learning (RL), the optimal policy is given by a Boltzmann distribution. Generating samples from this distribution can be challenging, as it is often complex and multimodal. While flow policies trained with flow matching provide a powerful framework for represent...

Denis Blessing, Onur Celik, Gerhard Neumann · 0 citations
#machine learning Preprint Oct 2026

Cross-Behavior Policy Optimization: Unified Learning from Offline Demonstrations and On- and Off-Policy Rollouts via a Shared Regression Target

Reasoning post-training draws on offline demonstrations and policy-generated rollouts, yet conventional supervised fine-tuning (SFT) followed by reinforcement learning (RL) separates their objectives and limits continued reuse of collected responses. We propose \textbf{Cross-Behavior Policy Optimization} (CBPO), which...

Du Cheng, Jun-Yu Lu, Jing-Fan Zhang et al. · 0 citations
#machine learning Preprint Oct 2026

TreeHCA: Hindsight-Guided Exploration and Credit Assignment for Multi-Turn LLM Agents

Outcome-supervised group-relative policy optimization (GRPO) assigns the same advantage to every token in an LLM agent trajectory, leaving useful and unhelpful decisions undifferentiated. Hindsight credit assignment (HCA) can refine this feedback, but its estimates rely on trajectories containing informative alternativ...

Debajoy Mukherjee, Jeremy Carleton, Sushil Vemuri et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Inverse Synthesis of Shock Time Series from Shock Response Spectra Using Ensembles of Conditional Variational Autoencoders

The shock response spectrum (SRS) characterizes the peak responses of single-degree-of-freedom systems to transient acceleration. Because the mapping from an acceleration time series (waveform) to its SRS is many-to-one, inverse synthesis seeks candidate waveforms consistent with a prescribed spectrum. We extend an ear...

Adam Watts, Charles Young, Ryan Bowering et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Deploying RDMA for Large-Scale Inference and Training Workloads

RDMA can reduce communication overhead in distributed machine learning systems, but realizing these benefits in production requires more than replacing TCP. Variable-size messages, concurrent connections, bursty incasts, and service failures introduce challenges that hardware offload alone cannot address. This paper re...

Yibo Huang, Yi Cui, Yukai Huang et al. · 0 citations
#machine learning Preprint Open access Oct 2026

The Expressive Power of Random-Feature MPNNs Across Graph Sizes

Continuous random node features increase the expressivity of message-passing neural networks (MPNNs), but existing theoretical analyses are not fine-grained enough to capture their limitations, particularly in approximating functions across graph sizes or under a fixed number of random bits. We develop a population-lev...

Robert R. Nerem, Mitchell Black, Antonis Vasileiou et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Coordinate-Free Automatic Differentiation

Automatic differentiation (AD) is a cornerstone of modern machine learning. Since all AD frameworks implicitly fix a basis of Euclidean space to define gradients and Jacobians, they natively process mathematical objects that are arrays of a fixed set of coordinates. This makes it awkward to express objects such as rota...

Alex Guerra, Joshua Aduol, Yaqian Tang et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Provenance-grouped protocol for evaluating machine learning in perovskite photovoltaics

Machine-learning models for perovskite solar cells are typically evaluated using random data splits, which we show systematically leak information through massive internal duplication. Because nearly two-thirds of curated devices share their exact recipe with another, random splits primarily reward the mere recall of h...

Qiwei Han, Chi Zhou · 0 citations
#machine learning Preprint Open access Oct 2026

NV-Tesseract-AD: Curriculum-Enhanced Conditional Diffusion for Multivariate Time-Series Anomaly Detection

We propose NV-Tesseract-AD, a curriculum learning-enhanced conditional diffusion framework for multivariate time-series anomaly detection. Our central hypothesis is that reconstruction difficulty can be explicitly structured along two complementary axes, masking severity and diffusion noise level, and that training fro...

Aditi Gautam, Manikandan Ravikiran, Saira Qureshi et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Static Gradient Attribution Underperforms a Density-Matched Random Mask on Loss-Based Forgetting Within LoRA B-Matrix

Parameter-efficient continual learning updates a restricted subset of adapter parameters to incorporate sequential tasks while limiting catastrophic forgetting. Gradient attribution is a common rule for selecting that subset, but it requires an additional backward pass over calibration data. We identify a parameter-poo...

Yu Sun, Junwei Zhou, Zuodong Xiang et al. · 0 citations
#machine learning Preprint Oct 2026

Neural expectation-maximization and meta-models

We interpret Transformer networks as learned approximations to a hybrid probabilistic-inference procedure that combines max-product Loopy Belief Propagation (LBP) with Expectation--Maximization (EM). In this view, a Transformer performs inference in partially observed Markov Random Fields (MRFs) whose structure and par...

Zhuo-Lin Fu · 0 citations
#machine learning Preprint Open access Oct 2026

Kernelized Parameter Sensitivity Atlases for Amortized Conditional Interpretability

Gradient-based attribution provides input-specific information about model parameters, but computing it via backpropagation for many samples is expensive, while static importance scores discard input dependence. We derive KPSA (Kernelized Parameter Sensitivity Atlas) from a block decomposition of the empirical neural t...

Davide Wiest, Ahanaf Hasan Ariq, Abdul Monaf Chowdhury · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 12, 2026

Simulating student learning for better AI tutoring

StudentSim is a research system for evaluating and improving AI tutoring tools before they are tested with learners. It models how individuals may engage with tutors, giving feedback to improve tutor performance across subjects like chess, writing, and mathematics. The post Simulating student learning for better AI tutoring appeared first on Microsoft Research.

MIT News · Artificial Intelligence Oct 7, 2026

Discovering the value of humanistic inquiry

Students in MIT’s Concourse program delve deeply into the human condition, debate challenging questions, and learn to develop judgment about issues that can’t be quantified.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.