Skip to content

Category

machine learning

12,457 papers

#machine learning Preprint Open access Oct 2026

Sequential Pretraining Favors Large Models

Large neural networks often acquire capabilities that small models fail to learn. Does this stem from large models learning more representative features, or from being more robust to unaccounted-for adverse effects introduced during training? We define and quantify one such adverse effect, primacy bias, as the extent t...

Mohnish Harwani, Yujia Zheng · 0 citations
#machine learning Preprint Open access Oct 2026

Decoupled Optimization for Teacher-Student Semi-Supervised Learning via a Pioneer Student

Semi-supervised learning (SSL) relies on two core mechanisms: self-training under the Teacher-Student (T-S) framework and joint optimization of labeled and unlabeled losses. Despite their effectiveness, we find both mechanisms introduce distinct optimization pathologies. First, parameter coupling enforces strict synchr...

Haorong Han, Jidong Yuan, Chixuan Wei et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Lightweight and Versatile Learned Optimization by Recombination of Gradient History

This paper presents a lightweight and versatile learned optimizer that dynamically recombines gradient history, represented as averages over disjoint time spans. The optimizer reduces the prediction space to one scalar coefficient per gradient average, shared by multiple parameters. Progressively averaging older gradie...

Minyoung Choi, Dalta Imam Maulana, Wanyeong Jung · 0 citations
#machine learning Preprint Open access Oct 2026

COPC: Coupled Off-Policy Correction for Asynchronous LLM Reinforcement Learning

Asynchronous RL accelerates large language model post-training by decoupling rollout generation from optimization, but trains on stale trajectories. Existing methods primarily correct token-level policy mismatch through importance-ratio control in the actor objective. We show that this \emph{policy-side correction} alo...

Zicheng Hu, Zhijian Zhou, Xuan Zhang et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Online Resource Allocation with an Endogenous Markov State: Fewer LP Solves Earn More

We study finite-horizon online resource allocation with i.i.d. requests and an endogenous Markov state on a finite state space: each action affects the transition of the state that governs future rewards and resource consumption. In this problem, a transient fluid LP benchmark upper bounds the expected reward of every...

Zhaohua Chen · 0 citations
#machine learning Preprint Open access Oct 2026

EvoSignal: LLM-Guided Evolutionary Design of Modular Traffic Signal Control Programs

Effective traffic signal control (TSC) requires policies that respond to changing traffic demand and network conditions while meeting different control objectives. However, adapting existing strategies often involves repeated manual design and adjustment, making it difficult to systematically explore better control rul...

Leizhen Wang, Peibo Duan, Zhenlin Qin et al. · 0 citations
#machine learning Preprint Open access Oct 2026

UniCSI Towards a Universal Wi-Fi CSI Encoder for Ubiquitous Human Sensing

Wi-Fi sensing promises to turn the everyday wireless signals that already surround us into ubiquitous sensors for human sensing. However, a fundamental obstacle is that CSI is acquired under diverse device-specific configurations, including different subcarrier counts, bandwidths, and carrier bands. Consequently, the r...

Daniel Eckhoff, Hua Kang, Zhitang Chen et al. · 0 citations
#machine learning Preprint Open access Oct 2026

A Framework for the Systematic Review of ML Assets in AI Registries

Background: Modern software systems increasingly rely on Machine Learning (ML) assets (i.e., pre-trained models, datasets, benchmarks) for building, evaluating, and integrating ML-based systems. However, current exploration, selection and reuse practices of ML assets are not supported by systematic retrieval methodolog...

Alexandra Gonz\'alez, Quim Motger, Xavier Franch et al. · 0 citations
#machine learning Preprint Open access Oct 2026

CircuitGate: Logic-Consistent Circuit-Level Functional Modeling for And-Inverter Graphs

And-Inverter Graphs (AIGs) are fundamental representations for logic synthesis and verification in Electronic Design Automation (EDA). As structured representations of complex digital systems, AIGs require models to capture functional dependencies beyond local structure and remain robust to functionality-preserving tra...

Qifan Zhang, Ruijie Li, Fangzhou Zhang et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Differential Refresh Policies for Models Trained on Lagging Data Snapshots: From a Single-Age Equivalence Limit to an Optimal Per-Segment Allocation

Production machine-learning models are derived artifacts of time-bounded training snapshots: a deployed model is a materialized view over a training cut that ages the instant it is built. A common response is to replace the fixed retraining cadence with an adaptive trigger -- a weighted staleness score that retrains wh...

Amit Rajula · 0 citations
#machine learning Preprint Open access Oct 2026

Physics-Informed Neural Plasticity: PDE Solvers That Reshape Themselves

Physics-informed neural PDE solvers adapt their parameters to satisfy governing equations, yet their representational structure typically remains fixed throughout training. This rigidity is poorly matched to PDE solutions with strongly heterogeneous complexity across space and space--time, leaving capacity insufficient...

Chun-Wun Cheng, Bingcheng Hu, Angelica I. Aviles-Rivero · 0 citations
#machine learning Preprint Open access Oct 2026

CHASE: Channel-Aligned Structure Exploitation for Geometry-Aware Model Engineering

Geometric and Spectral Alignment (GSA) characterizes trained networks through spectral concentration, physical-channel alignment, support structure, and changes in singular bases. In this paper, we propose CHASE (Channel-Aligned Structure Exploitation) to use these structures in practical model design. CHASE covers six...

Wei Wang, Wei Jiang, Ziran Liu · 0 citations

From tech blogs

See all →
MIT News · Artificial Intelligence Oct 7, 2026

Discovering the value of humanistic inquiry

Students in MIT’s Concourse program delve deeply into the human condition, debate challenging questions, and learn to develop judgment about issues that can’t be quantified.

Microsoft Research Blog Oct 7, 2026

Agent Lightning v1.0: A 3,500-Line Lightweight Agentic RL Framework for Training Agents with Real Harnesses

Training AI agents with reinforcement learning can be challenging because their tools, context, and decision-making are managed by complex frameworks. Agent Lightning connects existing agents to RL training, making it easier to improve them without rebuilding them. The post Agent Lightning v1.0: A 3,500-Line Lightweight Agentic RL Framework for Training Agents with Real Harnesses appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.