Sep 2026· IEEE Transactions on Neural Networks and Learning Systems· Vol PP· 0 citations
Medicine
TL;DR
SMArT enriches intrapatch semantics through self-supervised multiview fusion, and establishes an effective framework for TSF by integrating self-driven multiview learning with LLMs' reasoning power.
Abstract
Time series forecasting (TSF) is critical in numerous real-world applications, yet its sequential scalar presentation limits semantic richness and the capture of complex temporal patterns. Recent advances leveraging patchwise modeling and pretrained large language models (LLMs) have achieved notable progress. However, existing methods largely focus on raw sequential patterns while overlooking intrapatch semantics, which limits the richness of time series representations, and they fail to effectively exploit complementary information from multiple views. To tackle these challenges, we propose a self-driven multiview architecture for TSF (SMArT). SMArT enriches intrapatch semantics through self-supervised multiview fusion. It jointly captures fine-grained temporal 1-D dependencies via pointwise self-attention and global temporal 2-D structures via Gramian angular fields (GAFs), all without requiring external supervision. To further bridge the gap between time series data and LLMs, SMArT pioneers a dual-prompt strategy, combining static, dataset-level guidance with dynamic, input-specific prompts derived from frequency-domain decomposition, significantly enhancing LLMs' adaptability and generalization. Extensive experiments across diverse TSF tasks validate SMArT's robustness, achieving state-of-the-art performance in long-term forecasting and excelling in few-shot and zero-shot scenarios. By integrating self-driven multiview learning with LLMs' reasoning power, SMArT establishes an effective framework for TSF. Our code and Supplementary Materials are available at https://github.com/BMRETURN/SMArT.
This work defines cross-modal attention as a selection process, where semantic prompts are employed to induce a sparse temporal attribution distribution over temporal positions and employs low-entropy regularization alongside global cross-modal consistency constraints to regulate the selection behavior.
Xue-Yun Luo, Qiang Lu, Sangui Jian et al.· Proceedings of the Thirty-Fi...· 0 citations
This work proposes MUSE, a dependency-aware adaptation framework built on a fully frozen pretrained MAE, which performs lightweight refinement at different encoder depths and explicitly models across-period temporal dependencies and within-period periodic dependencies.
Xin-Ying Cai, Jun-Kai Lu, Yu-Han Zhu et al.· 0 citations
This work proposes SAGE (Seeing and Augmenting with Grounded Encoding), an end-to-end CLIP-based framework that jointly models temporal, cross-variable, textual, and visual information and achieves state-of-the-art accuracy.
This work proposes CLaST, a VAE framework for probabilistic multivariate time series forecasting that learns embeddings that preserve contextual similarity between observations through the authors' contrastive loss function.
A. Marusov, D. Anikin, P. Sokerin et al.· 0 citations
Multivariate long-sequence time series forecasting (MLSTF) is critical in applications such as electricity consumption planning, where accurate prediction requires models to capture complex temporal dependencies over extended horizons while remaining computationally efficient. Current MLSTF methods are largely built up...
Zhi-Yuan Zuo, Zhao-Ming Tian, Xiao-Yu Cao et al.· 2026 IEEE 22nd International...· 0 citations
Large Language Models (LLMs) have shown strong potential in multivariate time series forecasting and anomaly detection. Existing studies predominantly inject temporal information into LLMs via direct numerical tokenization or heuristic textual descriptions. However, LLMs still face difficulty in perceiving the underlyi...