EMDFormer model for time series forecasting

被引:5
作者
de Rojas, Ana Lazcano [1 ]
Jaramillo-Moran, Miguel A. [2 ]
Sandubete, Julio E. [1 ]
机构
[1] Univ Francisco Vitoria, Fac Law & Business, Madrid, Spain
[2] Univ Extremadura, Sch Ind Engn, Dept Elect Engn Elect & Automat, Badajoz 06006, Spain
来源
AIMS MATHEMATICS | 2024年 / 9卷 / 04期
关键词
time series forecasting; financial forecasting; recurrent neural network; LSTM BiLSTM; transformer; EMD; NEURAL-NETWORK; DECOMPOSITION; ELECTRICITY; PREDICTION; ENERGY; WIND;
D O I
10.3934/math.2024459
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
The adjusted precision of economic values is essential in the global economy. In recent years, researchers have increased their interest in making accurate predictions in this type of time series; one of the reasons is that the characteristics of this type of time series makes predicting a complicated task due to its non-linear nature. The evolution of artificial neural network models enables us to research the suitability of models generated for other purposes, applying their potential to time series prediction with promising results. Specifically, in this field, the application of transformer models is assuming an innovative approach with great results. To improve the performance of this type of networks, in this work, the empirical model decomposition (EMD) methodology was used as data preprocessing for prediction with a transformer type network. The results confirmed a better performance of this approach compared to networks widely used in this field, the bidirectional long short term memory (BiLSTM), and long short term memory (LSTM) networks using and without EMD preprocessing, as well as the comparison of a Transformer network without applying EMD to the data, with a lower error in all the error metrics used: The root mean square error (RMSE), the root mean square error (MSE), the mean absolute percentage error (MAPE), and the R -square (R2). Finding a model that provides results that improve the literature allows for a greater adjustment in the predictions with minimal preprocessing.
引用
收藏
页码:9419 / 9434
页数:16
相关论文
共 53 条
[21]   An artificial neural network (p, d, q) model for timeseries forecasting [J].
Khashei, Mehdi ;
Bijari, Mehdi .
EXPERT SYSTEMS WITH APPLICATIONS, 2010, 37 (01) :479-489
[22]  
Kim J., 2019, J. Ambient Intell. Humaniz. Comput, DOI [DOI 10.1007/S12652-019-01398-9, 10.1007/s12652-019-01398-9]
[23]  
Kotsiantis SB, 2006, PROC WRLD ACAD SCI E, V12, P278
[24]   A novel hybrid model combining βSARMA and LSTM for time series forecasting [J].
Kumar, Bhupendra ;
Sunil ;
Yadav, Neha .
APPLIED SOFT COMPUTING, 2023, 134
[25]   Short-Term Load Forecasting Based on Deep Neural Networks Using LSTM Layer [J].
Kwon, Bo-Sung ;
Park, Rae-Jun ;
Song, Kyung-Bin .
JOURNAL OF ELECTRICAL ENGINEERING & TECHNOLOGY, 2020, 15 (04) :1501-1509
[26]   Forecasting spot electricity prices: Deep learning approaches and empirical comparison of traditional algorithms [J].
Lago, Jesus ;
De Ridder, Fjo ;
De Schutter, Bart .
APPLIED ENERGY, 2018, 221 :386-405
[27]   A Combined Model Based on Recurrent Neural Networks and Graph Convolutional Networks for Financial Time Series Forecasting [J].
Lazcano, Ana ;
Herrera, Pedro Javier ;
Monge, Manuel .
MATHEMATICS, 2023, 11 (01)
[28]   Stock Price Prediction Using a Frequency Decomposition Based GRU Transformer Neural Network [J].
Li, Chengyu ;
Qian, Guoqi .
APPLIED SCIENCES-BASEL, 2023, 13 (01)
[29]   A novel Transformer-based network forecasting method for building cooling loads [J].
Li, Long ;
Su, Xingyu ;
Bi, Xianting ;
Lu, Yueliang ;
Sun, Xuetao .
ENERGY AND BUILDINGS, 2023, 296
[30]   A novel EMD and causal convolutional network integrated with Transformer for ultra short-term wind power forecasting [J].
Li, Ning ;
Dong, Jie ;
Liu, Lingyue ;
Li, He ;
Yan, Jie .
INTERNATIONAL JOURNAL OF ELECTRICAL POWER & ENERGY SYSTEMS, 2023, 154