Skip to content
Open access

A traffic flow forecasting model with embedded sparse dynamic graph convolution and multi-head attention LSTM

Aug 2026 · Frontiers of Computer Science · 0 citations · 17 references

TL;DR

Experimental results on the public PEMS04 and PEMS08 datasets demonstrate that the proposed ESDG-ALSTM model significantly improves forecasting accuracy, confirming that ESDG-ALSTM is more sensitive to abrupt events and multimodal evolution patterns and can effectively enhance prediction performance in complex traffic flow scenarios.

Abstract

To address the limitations of graph convolution-based traffic flow forecasting models, in which predefined static graphs are unable to adapt to the dynamic evolution of road networks and conventional LSTM models fail to finely characterize temporal dynamics, this study proposes an ESDG-ALSTM traffic flow forecasting model, namely an Embedded Sparse Dynamic Graph Convolutional LSTM model with Multi-Head Attention. First, a sparse dynamic graph convolution module is developed to integrate the physical topology and implicit semantic features of traffic flow data. Combined with a Top-K strategy, the adjacency matrix is dynamically reconstructed to enable adaptive capture of time-varying spatial dependencies while effectively suppressing long-tail noise. Next, an improved LSTM unit enhanced by multi-head attention is designed to model abrupt events and multimodal evolution patterns in traffic flow. Through multi-subspace projection and dynamic weight allocation, the hidden-state update process of the LSTM unit is restructured, thereby enabling deep extraction of traffic temporal features. Finally, a deeply coupled spatiotemporal feature network is constructed, in which graph convolution is further employed to refine the output states of the LSTM gates, achieving deep coupling and synchronized extraction of spatial and temporal features. Experimental results on the public PEMS04 and PEMS08 datasets demonstrate that the proposed model significantly improves forecasting accuracy, confirming that ESDG-ALSTM is more sensitive to abrupt events and multimodal evolution patterns and can effectively enhance prediction performance in complex traffic flow scenarios.

Read PDF

Similar papers

Open access 2026

Traffic Flow Prediction Based on Multi-Scale Graph Convolution Enhanced Large Language Model

The proposed MSG-LLM traffic flow forecasting framework significantly outperforms existing mainstream models in both short-term and long-term traffic flow forecasting tasks, validating the effectiveness and strong generalization ability of MSG-LLM in modeling complex traffic systems.

Chuangchuang Zhang, Zeng-Xu Song, Haiquan Shao · 0 citations
Open access Jul 2026

Traffic Flow Prediction System Based on Spatiotemporal Graph Neural Network

This framework introduces an adaptive graph learning module that dynamically infers meaningful connectivity relationships among traffic sensors—not relying on fixed geographic or distance-based assumptions—but instead leveraging real-time traffic correlations and node-level embeddings, enabling effective modeling of both localized spatial interactions and multi-scale temporal dependencies across varying prediction horizons.

Zhengxu Luan, Huan Wang, Miaobowen Wang et al. · 0 citations
Open access Jul 2026

Recurrent Graph Neural Network Hybrid Model for Spatio-Temporal Traffic Flow Prediction in Intelligent Transportation Systems

TETRA is proposed, a hybrid spatio-temporal traffic forecasting model that integrates Graph Convolutional Networks (GCNs) with Extended Long Short-Term Memory (xLSTM) to capture complex multi-timescale temporal patterns, including congestion propagation and delayed recovery dynamics, which are not well represented by conventional recurrent models.

Norman Bereczki, Vilmos Simon · 0 citations
Conference Aug 2026

Attention and residual adaptation analysis of node-token GPT2 for traffic flow forecasting

Traffic flow forecasting aims to predict future traffic states from historical observations of road networks. Although pretrained language models have demonstrated strong sequence modeling capacity, directly applying GPT-2 to traffic forecasting remains nontrivial because continuous spatiotemporal signals differ substantially from discrete text tokens. To address this issue, this paper proposes a node-tokenized GPT-2 framework and investigates attention adaptation and residual prediction mechanisms for traffic flow forecasting. Specifically, each traffic node is represented as a token by projecting its historical observations into the GPT-2 embedding space. Based on this representation, three attention mechanisms are compared, including causal attention, dense full attention, and dynamic Top-K sparse attention. In addition, a residual prediction strategy is introduced to model future traffic changes relative to the latest observed state. Experiments on the PeMS08 dataset show that GPT2-Causal-Res achieves the best performance, with an MAE of 15.3144, reducing the error by 3.47% compared with the direct prediction baseline. The results indicate that residual prediction improves forecasting accuracy, whereas simply modifying the attention structure does not necessarily lead to reliable modeling of traffic node interactions.

Ming-Zhu Gao, Ruo-Han Ning · 0 citations
Open access Jul 2026

Tensor-evolving graph with temporal separation network for traffic flow forecasting

A Tensor-Evolving Graph with Temporal Separation Network (TEG-TSNet) for traffic flow forecasting is proposed, which constructs a unified spatial prior via graph Laplacian spectral embedding and introduces a time-conditioned structure generation paradigm.

Hongyan Wang, Linlong Chen · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.