Skip to content

Category

machine learning

17,191 papers

#machine learning Preprint Open access Oct 2026

SPIN: Shadow Predictive Indexer for Sparse Attention

Indexer-based sparse attention reduces the cost of core attention by passing only a fixed, small number of important tokens to it. However, the indexer must still score the entire KV cache at every decoding step. This scoring overhead becomes a major bottleneck as the context length grows. We propose SPIN (Shadow Predi...

Yao Fu, Cyrus Chang, Ritchie Zhao et al. · 0 citations
#machine learning Preprint Oct 2026

Neighborhood Smoothing for Calibration

Modern neural networks are often miscalibrated, with a tendency to overconfidence. Existing train-time calibration methods largely modify task losses or calibration penalties, leaving neighborhood structure in learned representations underexploited. We introduce graph smoothing as a general principle for train-time cal...

Idan Horowitz, Avigdor Gal · 0 citations
#machine learning Preprint Open access Oct 2026

Removing Information Content Does Not Certify Tamper Resistance in Open-Weight Models

Does removing harmful information make open-weight models resistant to fine-tuning attacks? We show that mutual information at release alone cannot universally certify slow recovery. Function-preserving reparameterizations leave information unchanged while altering gradient-descent geometry, so an invariant certificate...

Domenic Rosati, Alessa Carbo, Ali Dadsetan et al. · 0 citations
#machine learning Preprint Open access Oct 2026

REFIT: Recognize, Fix, and Test Wearable Sensor Placement Shifts without Labels

We present REFIT, an input calibration for frozen activity-recognition models whose inertial sensors are worn differently at deployment than in training. When users move a watch to the other wrist or put a strap sensor back on turned, the model sees the same motion on changed axes. REFIT undoes such shifts without labe...

Bangxun Tang · 0 citations
#machine learning Preprint Oct 2026

SNR-Gated LSTM-Conditioned Diffusion Model for MIMO Channel Estimation

Accurate and low latency channel estimation is critical for modern MIMO systems, particularly under mobility, where channels exhibit structured sparsity and strong temporal correlation. This paper proposes a time-series conditioned diffusion framework for channel estimation that performs denoising in the angular domain...

Ji-Xing Zhou, Xin-Ming Huang · 0 citations
#machine learning Preprint Oct 2026

The Best Optimizer Depends on Batch Size

A plethora of new adaptive optimizers are designed to efficiently estimate and use minibatch gradient statistics to shape parameter updates, but they are typically benchmarked at a single batch size. Hyperparameter scaling rules promise to preserve performance as batch size and gradient noise change, suggesting that th...

Xing-Yu Dang, Kai-Yue Wen, Sadhika Malladi · 0 citations
#machine learning Preprint Open access Oct 2026

Directed Temporal Representations for Offline Visual Control

Predictive world models provide compact visual representations for control. Control requires a latent geometry aligned with temporal reachability rather than predictive similarity alone. We introduce Directed Temporal Representations for Control (DTRC), which learns such a geometry from offline visual trajectories on t...

Chenyang Yuan, Haoyu Wang, Zhuo Sun et al. · 0 citations
#machine learning Preprint Sep 2026

HCPN-GCN: Scaling Hierarchical Prototype Networks with Cone Geometry for Continual Graph Learning

HCPN-GCN is proposed, a graph-aware extension of HPN that replaces the original linear feature extractors with Graph Convolutional Networks (GCNs) and introduces cone-based prototypes with a diversity regularization objective, which produces richer graph-aware representations while compactly modeling the embedding spac...

S. Silva, V. L. S. Freitas, Gladston J. P. Moreira et al. · 0 citations
#machine learning Preprint Sep 2026

A Vehicle-Integrated Approach to Digital Twin Deployment for Bridges Through Drive-By Sensing

Ageing bridge infrastructure is a growing global concern, yet conventional Structural Health Monitoring (SHM) systems are costly and difficult to scale, and routine visual inspections remain subjective. Drive-by, or indirect, bridge inspection, in which a sensorised vehicle recovers structural information from vehicle-...

Zi-Hao Liu, D. Kawabe, Jia-Ji Wang et al. · 0 citations
#machine learning Preprint Sep 2026

Task-Oriented Key-Layer KV Communication for Efficient Latent Multi-Agent Collaboration

Large language model-based multi-agent systems improve complex problem solving through collaboration, while latent communication directly transmits model internal states to avoid the high inference costs of natural language. However, existing KV-based latent communication methods prioritize sender-side state fidelity,...

Dong-Sen Zhang, Pei-Pei Li, Ze-Kun Li et al. · 0 citations
#machine learning Preprint Sep 2026

DenoFlow: Flow Matching for SSVEP Denoising under Real Physiological Artifacts

DenoFlow is proposed, which casts SSVEP denoising as transport: instead of learning a direct map from a contaminated trial to a clean one, a field network regresses the velocity of the straight path between them, following the rectified-flow formulation, and denoising integrates that field forward from the observation.

Zhen He, Zi-Wei Wang, Dong-Rui Wu · 0 citations
#machine learning Preprint Sep 2026

The Cost of Long Memory: State, Context, and Stability Complexity in Sequence Models

Long-range temporal dependence poses a resource question for sequence models: for a specified predictive-memory law, how much state, context, or dynamical criticality is required in order to forecast accurately? We study this question directly in forecasting risk. For algebraically decaying predictive memory, we prove...

Yu-Heng Song · 0 citations

From tech blogs

See all →
Microsoft Research Blog Nov 3, 2026

Learn the rules: The hacker mindset

Research Manager Mike Walker reflects on a career spanning hacker culture, cybersecurity, and AI, sharing lessons about trust, teamwork, leadership, and why solving difficult problems requires curiosity, judgment, agility—and an understanding of the rules. The post Learn the rules: The hacker mindset appeared first on Microsoft Research.

Google DeepMind Blog Nov 3, 2026

Agentic cheminformatics with Google Antigravity

Learn how Google Antigravity and our Cheminformatics Skills accelerate drug discovery workflows, search compounds, and propose novel rigidified macrocycles.

MIT News · Artificial Intelligence Oct 28, 2026

Making machines that can listen

Professor Paris Smaragdis develops computers with superhuman hearing for applications like speech recognition, music understanding, and environmental monitoring.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.