Skip to content

Category

machine learning

12,457 papers

#machine learning Preprint Open access Oct 2026

The Symbol of the Surrogate: Measuring Numerical Provenance in Neural PDE Solvers

Neural PDE surrogates are trained on numerical solver outputs that contain both physical evolution and solver-specific discretization errors. Because surrogates are also evaluated against held-out trajectories from the same solver, standard benchmarks cannot distinguish fidelity to the exact evolution from imitation of...

Ridham Patel · 0 citations
#machine learning Preprint Oct 2026

Symmetry-Informed Causal Partial Identification

Partial identification (PI) entails estimating bounds on causal effects by encoding different assumptions on data generation as a constrained optimization problem. Such bounds can suffice to inform policy decisions even if the causal effect itself is not identifiable. Often vacuous in practice, practitioners seek to ex...

Uzair Akbar, Z. Zaidi, Niki Kilbertus et al. · 0 citations
#machine learning Preprint Open access Oct 2026

An Accuracy--Information Tradeoff for Loss-Difference Conditional Mutual Information

Loss-difference conditional mutual information (ld-CMI) uses the smallest of the standard observations in the supersample hierarchy of generalization bounds: it measures what a learner's loss differences reveal about which candidate of each pair it was trained on. Accuracy is known to force information into the model;...

Hazar Yueksel · 0 citations
#machine learning Preprint Oct 2026

Exact Dynamics and Finite-Sample Trajectory Recovery of Linear Recursive Feature Machines

Recursive feature machines (RFMs) learn representations of data by alternating between fitting a predictor to a dataset and updating features of that predictor using the average gradient outer product (AGOP). Connections between AGOPs and feature learning in neural networks motivate linear RFMs as a simple setting for...

Andrew Cheng, B. Kiani, Yue M. Lu et al. · 0 citations
#machine learning Preprint Oct 2026

The Dichotomy Between Pattern Recognition and Step-by-Step Reasoning

We argue that pattern recognition and step-by-step reasoning are two ends of a spectrum. A large language model (LLM) learns to reason step-by-step when data is structured such that the next token depends on a small amount of preceding context. Inference in LLMs resembles pattern recognition when the next token depends...

Amrut Nadgir, Pratik Chaudhari, Vijay Balasubramanian · 0 citations
#machine learning Preprint Oct 2026

Q-PACE: Dynamic Precision Allocation for Quantization-Aware Training

Quantization-aware training (QAT) leverages lower-precision arithmetic to reduce the cost of LLM deployment, but aggressive quantization degrades final model performance. A common remedy is mixed-precision training, in which high precision is assigned to some of the layers to maintain performance while keeping the cost...

Alexandra Volkova, Matin Ansaripour, Erik Schultheis et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Context-aware Attention-based Gaussian Mixture Models for Vehicular Trajectory Prediction

Reliable and interpretable trajectory prediction is critical for cooperative and autonomous driving in complex and uncertain environments. This paper introduces a Context-Aware Attention-based Gaussian Mixture Model (CAA-GMM) for multimodal, uncertainty-aware motion forecasting. The proposed approach models future moti...

Arash Raftari, Babak Ebrahimi Soorchaei, Yaser P. Fallah · 0 citations
#machine learning Preprint Open access Oct 2026

Noise Your Prompt: Noising Conditioning Tokens in Continuous Diffusion Language Models

We revisit a standard accepted practice in the continuous diffusion language model literature of fixing conditioning prompt tokens clean during training. We make a very simple modification: also noise the conditioning prompt tokens during training. We demonstrate that under this modified training objective, we ac...

Justin Jung · 0 citations
#machine learning Preprint Open access Oct 2026

A Cognitive-Aware QML-CRL Framework for Detecting Affinity and Romance-Investment Fraud

We present a hybrid quantum-classical framework that detects affinity and romance-investment fraud by modelling the cognitive biases in a manipulative conversation. In our proposed framework, cognitive biases central to this fraud class are carried by dedicated qubits in a structured parameterized quantum circuit, toge...

Bibhas Adhikari, Ramya Srinivasan · 0 citations
#machine learning Preprint Open access Oct 2026

Directional Evidence Guided Search-Space Reduction for Exact DAG Learning

Learning a directed acyclic graph (DAG) from observational data is a challenging combinatorial problem due to the exponential growth in the number of candidate parent-set configurations. Existing exact score-based methods often require computationally intensive combinatorial search, whereas constraint-based methods can...

Upala Junaida Islam, Abdelmonem Elrefaey, Rong Pan · 0 citations
#machine learning Preprint Open access Oct 2026

Domain-informed Adaptive Sampling for Generalizable PINNs in Metal Additive Manufacturing via Conditional Flow Matching

Accurate thermal modeling is essential in metal additive manufacturing (AM) for understanding the process-structure-property chain. Physics-informed neural networks (PINNs) offer effective surrogate thermal modeling by minimizing physics-based residual losses at collocation points. However, prior works typically rely o...

Hyeonsu Lee, Jihoon Jeong · 0 citations
#machine learning Preprint Open access Oct 2026

Are Parameter-Efficient Fine-tuning Methods Really Different?

Parameter-efficient fine-tuning (PEFT) offers many parameterizations, yet their methodological and functional differences remain unclear. We compare six methods in language and diffusion models to examine how their parameterizations relate to task performance, forgetting, and changes in pretrained weight geometry. Moti...

Yikuan Li, Pinyan Lu, Fanghui Liu · 0 citations

From tech blogs

See all →
MIT News · Artificial Intelligence Oct 7, 2026

Discovering the value of humanistic inquiry

Students in MIT’s Concourse program delve deeply into the human condition, debate challenging questions, and learn to develop judgment about issues that can’t be quantified.

Microsoft Research Blog Oct 7, 2026

Agent Lightning v1.0: A 3,500-Line Lightweight Agentic RL Framework for Training Agents with Real Harnesses

Training AI agents with reinforcement learning can be challenging because their tools, context, and decision-making are managed by complex frameworks. Agent Lightning connects existing agents to RL training, making it easier to improve them without rebuilding them. The post Agent Lightning v1.0: A 3,500-Line Lightweight Agentic RL Framework for Training Agents with Real Harnesses appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.