Spatial-Temporal Graph Attention Gated Recurrent Transformer Network for Traffic Flow Forecasting

被引:9
作者
Wu, Di [1 ,2 ]
Peng, Kai [1 ,2 ]
Wang, Shangguang [3 ]
Leung, Victor C. M. [4 ,5 ]
机构
[1] Huaqiao Univ, Coll Engn, Quanzhou 362021, Peoples R China
[2] Nanjing Univ, State Key Lab Novel Software Technol, Nanjing 210023, Peoples R China
[3] Beijing Univ Posts & Telecommun, State Key Lab Networking & Switching Technol, Beijing 100876, Peoples R China
[4] Shenzhen Univ, Coll Comp Sci & Software Engn, Shenzhen 518060, Peoples R China
[5] Univ British Columbia, Dept Elect & Comp Engn, Vancouver, BC, Canada
基金
美国国家科学基金会;
关键词
Graph attention networks (GATs); spatial-temporal dependencies; traffic flow forecasting; transformer; NEURAL-NETWORKS;
D O I
10.1109/JIOT.2023.3340182
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the significant increase in the number of motor vehicles, road-related issues, such as traffic congestion and accidents, have also escalated. The development of an accurate and efficient traffic flow forecasting model is essential for helping car owners plan their journeys. Despite advancements in forecasting models, there are three remaining issues: 1) failing to effectively use cyclical data; 2) failing to adequately capture spatial dependencies; and 3) high-time complexity and memory usage. To tackle the aforementioned challenges, we present a novel spatial-temporal graph attention gated recurrent transformer network (STGAGRTN) for traffic flow forecasting. Specifically, the use of a spatial transformer module allows for the extraction of dynamic spatial dependencies among individual nodes, going beyond the limitation of only considering neighboring nodes. Subsequently, we propose a temporal transformer to extract periodic information from traffic data and capture long-term dependencies. Additionally, we utilize two additional classical techniques to complement the aforementioned modules for extracting characteristics. By incorporating comprehensive spatial-temporal characteristics into our model, we can accurately predict multiple nodes simultaneously. Finally, we have successfully optimized the computational complexity of the transformer module from O (n(2)) to O(n log n). Our model has undergone extensive testing on four authentic data sets, providing compelling evidence of its superior predictive capabilities.
引用
收藏
页码:14267 / 14281
页数:15
相关论文
共 47 条
[11]   Co-Optimization Scheme for the Powertrain and Exhaust Emission Control System of Hybrid Electric Vehicles Using Future Speed Prediction [J].
Hong, Wanshi ;
Chakraborty, Indrasis ;
Wang, Hong ;
Tao, Gang .
IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2021, 6 (03) :533-545
[12]   Adaptive Spatiotemporal Transformer Graph Network for Traffic Flow Forecasting by IoT Loop Detectors [J].
Huang, Boyu ;
Dou, Haowen ;
Luo, Yu ;
Li, Junchao ;
Wang, Jiaqi ;
Zhou, Teng .
IEEE INTERNET OF THINGS JOURNAL, 2023, 10 (02) :1642-1653
[13]   Learning Multiaspect Traffic Couplings by Multirelational Graph Attention Networks for Traffic Prediction [J].
Huang, Jing ;
Luo, Kun ;
Cao, Longbing ;
Wen, Yuanqiao ;
Zhong, Shuyuan .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (11) :20681-20695
[14]   Hierarchical Spatio-Temporal Graph Convolutional Networks and Transformer Network for Traffic Flow Forecasting [J].
Huo, Guangyu ;
Zhang, Yong ;
Wang, Boyue ;
Gao, Junbin ;
Hu, Yongli ;
Yin, Baocai .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2023, 24 (04) :3855-3867
[15]  
Kazemi SM, 2020, J MACH LEARN RES, V21
[16]   Spatial-Temporal Attention Graph Convolution Network on Edge Cloud for Traffic Flow Prediction [J].
Lai, Qifeng ;
Tian, Jinyu ;
Wang, Wei ;
Hu, Xiping .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2023, 24 (04) :4565-4576
[17]   Adaptive Spatial-Temporal Fusion Graph Convolutional Networks for Traffic Flow Forecasting [J].
Li, Senwen ;
Ge, Liang ;
Lin, Yongquan ;
Zeng, Bo .
2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
[18]   Lightweight Privacy-Preserving Scheme Using Homomorphic Encryption in Industrial Internet of Things [J].
Li, Shancang ;
Zhao, Shanshan ;
Min, Geyong ;
Qi, Lianyong ;
Liu, Gang .
IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (16) :14542-14550
[19]   Short-Term Traffic Flow Forecasting: An Experimental Comparison of Time-Series Analysis and Supervised Learning [J].
Lippi, Marco ;
Bertini, Matteo ;
Frasconi, Paolo .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2013, 14 (02) :871-882
[20]   Swin Transformer: Hierarchical Vision Transformer using Shifted Windows [J].
Liu, Ze ;
Lin, Yutong ;
Cao, Yue ;
Hu, Han ;
Wei, Yixuan ;
Zhang, Zheng ;
Lin, Stephen ;
Guo, Baining .
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, :9992-10002