Skip to content

Category

machine learning

15,848 papers

#machine learning Preprint Oct 2026

PGSB: Pretrained-Guided Shared Basis for LoRA Model Merging

Large pretrained models have achieved remarkable success across diverse domains, yet adapting them to multiple downstream tasks remains challenging: full fine-tuning is costly, while maintaining separate task-specific models is storage-inefficient and fails to produce a unified multi-task model. Low-Rank Adaptation (Lo...

Mu-Qing Liu, Chong-Jie Si, Zhuo-Ya Liu et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Query-Adaptive Neuron Steering for LLMs

Effectively eliciting the capabilities of large language models (LLMs) at inference time remains an important challenge. Existing studies address this challenge through context engineering, which shapes user queries, or fixed steering, which directly intervenes in model computation. However, predefined contexts and fix...

Yanxi Pan, Jingwen Wu, Yan Ma et al. · 0 citations
#machine learning Preprint Oct 2026

DEFT: Disentanglement-Enhanced Fine-Tuning for EEG Foundation Models

Disentangled EFM Fine-Tuning (DEFT) is proposed, a plug-and-play adapter for EFM fine-tuning that improves matched fine-tuning baselines and encourages branch disentanglement of pretrained tokens into task-oriented content and subject-consistent style.

Yu-Qiu Deng, Muyun Jiang, Zong-Peng Zhang et al. · 0 citations
#machine learning Preprint Open access Oct 2026

A Gated Catchment Hydrology Model (GCHM) for Physically-Interpretable Rainfall-Evapotranspiration-Runoff Simulation Across Diverse Hydroclimatic Regimes

Recent advances in machine learning have improved rainfall-runoff prediction, yet most data-driven models remain difficult to interpret and do not explicitly enforce physical conservation laws. We present the Gated Catchment Hydrology Model (GCHM), a mass-conserving architecture based on the Mass-Conserving Perceptron...

M Jawad, HV Gupta, MA Farmani et al. · 0 citations
#machine learning Preprint Oct 2026

Learning to Extrapolate in Depth with Looped Transformers

Looped transformers reuse a single block across iterations, raising a natural question: how far can a block trained at one depth be safely extrapolated to greater depths? We study this question for all-pairs graph connectivity, where harder graphs require longer-range information propagation. We show that under exchang...

Hui-Tao Yang, Jian-Hao Huang, Zi-Xuan Wang et al. · 0 citations
#machine learning Preprint Open access Oct 2026

From Transfer Probes to Expert Grouping: Evidence from LoRA Post-Training

A platform that post-trains one base model for many business lines often has more lines than experts it can maintain, so lines must share experts, yet lines seldom come with a taxonomy saying which should share. We ask whether transfer probes (train on one source, measure paired changes on all sources) can discover a g...

Xueyang Wu · 0 citations
#machine learning Preprint Open access Oct 2026

Design Choices for Multimodal Transformer Learning with Missing and Longitudinal Healthcare Data

Multimodal learning offers the potential to improve predictions by integrating complementary information from heterogeneous data sources. However, multimodal datasets are frequently incomplete, raising important questions about how models should handle missing information. Although recent approaches increasingly rely o...

Rita Cordeiro Mendes, Maria Manuel Pereira, Carlos Santiago et al. · 0 citations
#machine learning Preprint Open access Oct 2026

PotentialEP: Backprop-Free Training of CIFAR-Scale Generative Models via Equilibrium Propagation

Generating an image with a diffusion or flow-matching model typically involves integrating a velocity field for hundreds of sequential steps. That computation suits a GPU poorly and an analog neuromorphic substrate well, where one fast, low-power physical relaxation could replace the whole sequence. Two things are need...

Alex Gower · 0 citations
#machine learning Preprint Oct 2026

Sparse-TD-JEPA: Improving Zero-Shot Reinforcement Learning With Sparse Latent Task Representations

Successor-feature-based zero-shot reinforcement learning methods pre-train a task encoder and successor-feature predictor on offline, reward-free data, then recover a policy at test time by solving a closed-form linear regression over a small labeled dataset. We identify an underexplored limitation of this approach: wh...

Duaa Nakshbandi, Zhi-Yu An, Wan Du · 0 citations
#machine learning Review Oct 2026

Clinical value claims in multimodal AI outpace supporting evidence

Multimodal prediction models add a data source, such as imaging or an assay, to clinical information, and health systems must decide whether that added test is worth acquiring. We audited 177 studies comparing multimodal with unimodal models: 81 from a systematic review and 96 from a probability sample of 2025-2026 Pub...

Jia-Yu Feng · 0 citations
#machine learning Preprint Open access Oct 2026

DPAL: A Test-Time Adaptation Loss for Financial Time Series Forecasting

Test-time adaptation (TTA) enables time series forecasters to update after deployment as new observations become available. However, adaptation objectives that focus primarily on prediction errors at individual time steps do not fully address the needs of financial time series forecasting. In addition to pointwise retu...

Wuzhou Lian, Haochun Wang, Yuefan Deng · 0 citations
#machine learning Preprint Open access Oct 2026

When More Memory Fails: Hidden Feasibility Holes in Dynamic Tensor Rematerialization

Dynamic Tensor Rematerialization (DTR) trains neural networks under a memory budget by evicting tensors and recomputing them on demand. A natural expectation is that a budget large enough to complete training stays sufficient when it is increased. Using DTR's reference simulator, simrd, to replay the public DTR trainin...

Mahesh Reddy Pagadala · 0 citations

From tech blogs

See all →
MIT News · Artificial Intelligence Oct 23, 2026

Q&A: How AI came to model the “messy” human mind

Assistant Professor Benjamin Lindquist studies how engineers deliberately injected randomness into early AI, giving rise to deep-learning models that sometimes hallucinate.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.