Skip to content

SMArT: A Self-Driven Multiview Architecture Leveraging Large Language Models for Time Series Forecasting.

Sep 2026 · IEEE Transactions on Neural Networks and Learning Systems · Vol PP · 0 citations
Medicine

TL;DR

SMArT enriches intrapatch semantics through self-supervised multiview fusion, and establishes an effective framework for TSF by integrating self-driven multiview learning with LLMs' reasoning power.

Abstract

Time series forecasting (TSF) is critical in numerous real-world applications, yet its sequential scalar presentation limits semantic richness and the capture of complex temporal patterns. Recent advances leveraging patchwise modeling and pretrained large language models (LLMs) have achieved notable progress. However, existing methods largely focus on raw sequential patterns while overlooking intrapatch semantics, which limits the richness of time series representations, and they fail to effectively exploit complementary information from multiple views. To tackle these challenges, we propose a self-driven multiview architecture for TSF (SMArT). SMArT enriches intrapatch semantics through self-supervised multiview fusion. It jointly captures fine-grained temporal 1-D dependencies via pointwise self-attention and global temporal 2-D structures via Gramian angular fields (GAFs), all without requiring external supervision. To further bridge the gap between time series data and LLMs, SMArT pioneers a dual-prompt strategy, combining static, dataset-level guidance with dynamic, input-specific prompts derived from frequency-domain decomposition, significantly enhancing LLMs' adaptability and generalization. Extensive experiments across diverse TSF tasks validate SMArT's robustness, achieving state-of-the-art performance in long-term forecasting and excelling in few-shot and zero-shot scenarios. By integrating self-driven multiview learning with LLMs' reasoning power, SMArT establishes an effective framework for TSF. Our code and Supplementary Materials are available at https://github.com/BMRETURN/SMArT.

View source

Similar papers

Conference Open access Sep 2026

Attention as Selection: Semantic-Guided Time Series Forecasting

This work defines cross-modal attention as a selection process, where semantic prompts are employed to induce a sparse temporal attribution distribution over temporal positions and employs low-entropy regularization alongside global cross-modal consistency constraints to regulate the selection behavior.

Xue-Yun Luo, Qiang Lu, Sangui Jian et al. · 0 citations
#machine learning Preprint Sep 2026

MUSE: Dependency-Aware Adaptation of a Frozen Vision Backbone for Multivariate Time Series Forecasting

This work proposes MUSE, a dependency-aware adaptation framework built on a fully frozen pretrained MAE, which performs lightweight refinement at different encoder depths and explicitly models across-period temporal dependencies and within-period periodic dependencies.

Xin-Ying Cai, Jun-Kai Lu, Yu-Han Zhu et al. · 0 citations
Preprint Aug 2026

SAGE: Variate-Wise Semantic Augmentation for Vision-Language Time Series Forecasting

This work proposes SAGE (Seeing and Augmenting with Grounded Encoding), an end-to-end CLIP-based framework that jointly models temporal, cross-variable, textual, and visual information and achieves state-of-the-art accuracy.

Hai-Zhao Fan, Xinh Le · 0 citations
Conference Aug 2026

GraphReformer: Information-Bottleneck-Driven Implicit Structural Inference for Efficient Transformer-Based Time Series Forecasting

Multivariate long-sequence time series forecasting (MLSTF) is critical in applications such as electricity consumption planning, where accurate prediction requires models to capture complex temporal dependencies over extended horizons while remaining computationally efficient. Current MLSTF methods are largely built up...

Zhi-Yuan Zuo, Zhao-Ming Tian, Xiao-Yu Cao et al. · 0 citations
#artificial intelligence Open access Sep 2026

FreSia: Frequency-semantic instantiation and alignment for multivariate time series analysis

Large Language Models (LLMs) have shown strong potential in multivariate time series forecasting and anomaly detection. Existing studies predominantly inject temporal information into LLMs via direct numerical tokenization or heuristic textual descriptions. However, LLMs still face difficulty in perceiving the underlyi...

Yu-Bo Wang, Hui He, He-Zhe Qiao et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.