Deep Learning Method Based on Multiscale Enhanced Feature Fusion for Vehicle Behavior Prediction

被引:1
作者
Wang, Xingyu [1 ]
Luo, Qirui [1 ]
Liu, Kai [1 ]
Mao, Ruichi [1 ]
Wu, Guangqiang [1 ]
机构
[1] Tongji Univ, Sch Automot Studies, Shanghai 201804, Peoples R China
关键词
Hidden Markov models; Feature extraction; Predictive models; Deep learning; Data models; Long short term memory; Convolutional neural networks; Attention mechanisms; Mathematical models; Analytical models; Attention mechanism; behavior prediction; convolutional neural network (CNN); cross learning; feature fusion; RECOGNITION;
D O I
10.1109/JIOT.2024.3508034
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Vehicle behavior prediction (VBP) is a crucial area of research aimed at enhancing the safety of intelligent connected vehicles in complex traffic scenarios. However, many existing methods rely on 1-D driving data or lack the fusion processing of multiscale input features, leading to reduced model prediction accuracy and unnecessary computational load. In this study, we introduce a deep neural network for multiscale enhanced feature fusion. Initially, we utilize Gramian angular field (GAF) and exponential short-time Fourier transform (ESTFT) to transform 1-D data into a graph containing time-frequency information, thereby improving the interpretability of input features. Subsequently, we develop a multiscale cross-learning attention (MCA) mechanism to facilitate cross-domain and cross-scale feature interactions within the 2-D graph, along with a multiscale global attention (MGA) mechanism to enhance feature learning by considering the spatial relationships of 1-D data. Finally, we utilize multi head attention mechanism to allocate adaptive weights to multiscale enhanced feature information, and incorporate bi-directional long short-term memory (Bi-LSTM) to model time dependencies and generate prediction results. Our proposed approach demonstrates improved performance in VBP compared to existing methods, as validated on both HighD and NGSIM datasets.
引用
收藏
页码:9142 / 9155
页数:14
相关论文
共 46 条
[1]   Unsupervised Cross-Scenario Abnormal Driving Behavior Recognition Using Smartphone Sensor Data [J].
Chen, Xiaobo ;
Wang, Yong ;
Sun, Xiaodong ;
Cai, Yingfeng .
IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (08) :14698-14709
[2]   Intention-Aware Vehicle Trajectory Prediction Based on Spatial-Temporal Dynamic Attention Network for Internet of Vehicles [J].
Chen, Xiaobo ;
Zhang, Huanjia ;
Zhao, Feng ;
Hu, Yu ;
Tan, Chenkai ;
Yang, Jian .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (10) :19471-19483
[3]   Prediction Performance of Lane Changing Behaviors: A Study of Combining Environmental and Eye-Tracking Data in a Driving Simulator [J].
Deng, Qi ;
Wang, Jiao ;
Hillebrand, Kevin ;
Benjamin, Christoper Ragenold ;
Soeffker, Dirk .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2020, 21 (08) :3561-3570
[4]   A similarity-based neuro-fuzzy modeling for driving behavior recognition applying fusion of smartphone sensors [J].
Eftekhari, Hamid Reza ;
Ghatee, Mehdi .
JOURNAL OF INTELLIGENT TRANSPORTATION SYSTEMS, 2019, 23 (01) :72-83
[5]   SafeDriving: An Effective Abnormal Driving Behavior Detection System Based on EMG Signals [J].
Fan, Yuanzhao ;
Gu, Fei ;
Wang, Jin ;
Wang, Jianping ;
Lu, Kejie ;
Niu, Jianwei .
IEEE INTERNET OF THINGS JOURNAL, 2021, 9 (14) :12338-12350
[6]  
Gao K, 2023, IEEE T INTELL TRANSP, V24, P6203, DOI [10.1109/TITS.2023.3248842, 10.1109/INFOCOM53939.2023.10228877]
[7]   RFDANet: an FMCW and TOF radar fusion approach for driver activity recognition using multi-level attention based CNN and LSTM network [J].
Gu, Minming ;
Chen, Kaiyu ;
Chen, Zhixiang .
COMPLEX & INTELLIGENT SYSTEMS, 2024, 10 (01) :1517-1530
[8]   LSTM plus Transformer Real-Time Crash Risk Evaluation Using Traffic Flow and Risky Driving Behavior Data [J].
Han, Lei ;
Abdel-Aty, Mohamed ;
Yu, Rongjie ;
Wang, Chenzhu .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2024, 25 (11) :18383-18395
[9]  
Han T, 2019, IEEE INT VEH SYM, P957, DOI 10.1109/IVS.2019.8813987
[10]  
Hu J, 2018, PROC CVPR IEEE, P7132, DOI [10.1109/TPAMI.2019.2913372, 10.1109/CVPR.2018.00745]