BiLSTM-MLAM: A Multi-Scale Time Series Prediction Model for Sensor Data Based on Bi-LSTM and Local Attention Mechanisms

被引:10
作者
Fan, Yongxin [1 ]
Tang, Qian [2 ]
Guo, Yangming [3 ]
Wei, Yifei [2 ]
机构
[1] Northwestern Polytech Univ, Sch Comp Sci, Xian 710072, Peoples R China
[2] Beijing Univ Posts & Telecommun, Sch Elect Engn, Beijing 100876, Peoples R China
[3] Northwestern Polytech Univ, Sch Cybersecur, Xian 710072, Peoples R China
基金
英国科研创新办公室;
关键词
bidirectional long short-term memory; local attention mechanism; multi-scale patch segmentation; time series prediction; SHORT-TERM-MEMORY; SELECTION;
D O I
10.3390/s24123962
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
This paper introduces BiLSTM-MLAM, a novel multi-scale time series prediction model. Initially, the approach utilizes bidirectional long short-term memory to capture information from both forward and backward directions in time series data. Subsequently, a multi-scale patch segmentation module generates various long sequences composed of equal-length segments, enabling the model to capture data patterns across multiple time scales by adjusting segment lengths. Finally, the local attention mechanism enhances feature extraction by accurately identifying and weighting important time segments, thereby strengthening the model's understanding of the local features of the time series, followed by feature fusion. The model demonstrates outstanding performance in time series prediction tasks by effectively capturing sequence information across various time scales. Experimental validation illustrates the superior performance of BiLSTM-MLAM compared to six baseline methods across multiple datasets. When predicting the remaining life of aircraft engines, BiLSTM-MLAM outperforms the best baseline model by 6.66% in RMSE and 11.50% in MAE. In the LTE dataset, it achieves RMSE improvements of 12.77% and MAE enhancements of 3.06%, while in the load dataset, it demonstrates RMSE enhancements of 17.96% and MAE improvements of 30.39%. Additionally, ablation experiments confirm the positive impact of each module on prediction accuracy. Through segment length parameter tuning experiments, combining different segment lengths has resulted in lower prediction errors, affirming the effectiveness of the multi-scale fusion strategy in enhancing prediction accuracy by integrating information from multiple time scales.
引用
收藏
页数:16
相关论文
共 48 条
[1]   Cellular Traffic Prediction Based on an Intelligent Model [J].
Alsaade, Fawaz Waselallah ;
Al-Adhaileh, Mosleh Hmoud .
MOBILE INFORMATION SYSTEMS, 2021, 2021
[2]   Comparative analysis of Gated Recurrent Units (GRU), long Short-Term memory (LSTM) cells, autoregressive Integrated moving average (ARIMA), seasonal autoregressive Integrated moving average (SARIMA) for forecasting COVID-19 trends [J].
ArunKumar, K. E. ;
Kalaga, Dinesh, V ;
Kumar, Ch. Mohan Sai M. ;
Kawaji, Masahiro ;
Brenza, Timothy M. .
ALEXANDRIA ENGINEERING JOURNAL, 2022, 61 (10) :7585-7603
[3]   A Survey on Traffic Prediction Techniques Using Artificial Intelligence for Communication Networks [J].
Chen, Aaron ;
Law, Jeffrey ;
Aibin, Michal .
TELECOM, 2021, 2 (04) :518-535
[4]   Forecasting Stock Prices Using a Hybrid Deep Learning Model Integrating Attention Mechanism, Multi-Layer Perceptron, and Bidirectional Long-Short Term Memory Neural Network [J].
Chen, Qian ;
Zhang, Wenyu ;
Lou, Yu .
IEEE ACCESS, 2020, 8 :117365-117376
[5]  
CNNIC (China Internet Network Information Center), 2024, The 53rd Statistical Report on China's Internet Development Released
[6]   Feature selection for time series prediction - A combined filter and wrapper approach for neural networks [J].
Crone, Sven F. ;
Kourentzes, Nikolaos .
NEUROCOMPUTING, 2010, 73 (10-12) :1923-1936
[7]   Time series analysis of climate variables using seasonal ARIMA approach [J].
Dimri, Tripti ;
Ahmad, Shamshad ;
Sharif, Mohammad .
JOURNAL OF EARTH SYSTEM SCIENCE, 2020, 129 (01)
[8]   A Hybrid Residual Dilated LSTM and Exponential Smoothing Model for Midterm Electric Load Forecasting [J].
Dudek, Grzegorz ;
Pelka, Pawel ;
Smyl, Slawek .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (07) :2879-2891
[9]   Multi-Horizon Time Series Forecasting with Temporal Attention Learning [J].
Fan, Chenyou ;
Zhang, Yuze ;
Pan, Yi ;
Li, Xiaoyue ;
Zhang, Chi ;
Yuan, Rong ;
Wu, Di ;
Wang, Wensheng ;
Pei, Jian ;
Huang, Heng .
KDD'19: PROCEEDINGS OF THE 25TH ACM SIGKDD INTERNATIONAL CONFERENCCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2019, :2527-2535
[10]   Big Data Analytics in Weather Forecasting: A Systematic Review [J].
Fathi, Marzieh ;
Haghi Kashani, Mostafa ;
Jameii, Seyed Mahdi ;
Mahdipour, Ebrahim .
ARCHIVES OF COMPUTATIONAL METHODS IN ENGINEERING, 2022, 29 (02) :1247-1275