Optimizing Time-Series forecasting using stacked deep learning framework with enhanced adaptive moment estimation and error correction

被引:8
作者
Varshney, Ravi Prakash [1 ]
Sharma, Dilip Kumar [2 ]
机构
[1] S&P Global, Noida, India
[2] GLA Univ, Dept Comp Engn & Applicat, Mathura, India
关键词
Deep learning; Long short-term memory (LSTM); CNN; Time-series forecasting; Adaptive moment estimation (Adam); NEURAL-NETWORKS; ENSEMBLE; MODEL; PREDICTION;
D O I
10.1016/j.eswa.2024.123487
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Time-series forecasting is essential for decision-making activities, and deep learning models have shown promising results in this field. However, existing models face challenges in capturing the complex non-linear patterns and randomness of real-world time-series data. To address this issue, we propose a novel stacked deep learning framework that combines a bi-directional long-short-term memory network, convolutional 1D, and max-pooling-1D layers in each stack. We also introduce an enhanced version of adaptive moment estimation and an error correction method to improve the model's accuracy and convergence speed. We evaluate our model's performance using four real-world datasets (air quality, PM2.5, electricity price, and securities lending) and compare it with existing models based on statistical measures such as mean absolute error, mean squared error, and standard deviation. The results demonstrate that our proposed model outperforms existing models significantly, achieving a - 52 % improvement in mean absolute error for air quality data, a - 36 % improvement in mean squared error for the PM2.5 dataset, and a - 27.5 % improvement in mean squared error for electricity price data. The enhanced adaptive moment estimation and error correction method further improve the model's accuracy and generalization capabilities, making it suitable for multi-domain data sets. Our proposed model has potential applications in various fields, including manufacturing, traffic prediction, weather forecasting, environmental monitoring, finance, and energy management.
引用
收藏
页数:22
相关论文
共 42 条
[1]  
[Anonymous], National electricity market
[2]  
Ba J, 2014, ACS SYM SER
[3]   Short term forecasting of electricity prices for MISO hubs: Evidence from ARIMA-EGARCH models [J].
Bowden, Nicholas ;
Payne, James E. .
ENERGY ECONOMICS, 2008, 30 (06) :3186-3197
[4]   Wind speed forecasting using nonlinear-learning ensemble of deep learning time series prediction and extremal optimization [J].
Chen, Jie ;
Zeng, Guo-Qiang ;
Zhou, Wuneng ;
Du, Wei ;
Lu, Kang-Di .
ENERGY CONVERSION AND MANAGEMENT, 2018, 165 :681-695
[5]  
Cherkassky V, 1997, IEEE Trans Neural Netw, V8, P1564, DOI 10.1109/TNN.1997.641482
[6]  
Collobert R, 2011, J MACH LEARN RES, V12, P2493
[7]   On field calibration of an electronic nose for benzene estimation in an urban pollution monitoring scenario [J].
De Vito, S. ;
Massera, E. ;
Piga, A. ;
Martinotto, L. ;
Di Francia, G. .
SENSORS AND ACTUATORS B-CHEMICAL, 2008, 129 (02) :750-757
[8]  
Dua D., 2019, UCI MACHINE LEARNING
[9]  
Duchi J, 2011, J MACH LEARN RES, V12, P2121
[10]   A review of datasets and load forecasting techniques for smart natural gas and water grids: Analysis and experiments [J].
Fagiani, M. ;
Squartini, S. ;
Gabrielli, L. ;
Spinsante, S. ;
Piazza, F. .
NEUROCOMPUTING, 2015, 170 :448-465