EMDFormer model for time series forecasting

被引:5
作者
de Rojas, Ana Lazcano [1 ]
Jaramillo-Moran, Miguel A. [2 ]
Sandubete, Julio E. [1 ]
机构
[1] Univ Francisco Vitoria, Fac Law & Business, Madrid, Spain
[2] Univ Extremadura, Sch Ind Engn, Dept Elect Engn Elect & Automat, Badajoz 06006, Spain
来源
AIMS MATHEMATICS | 2024年 / 9卷 / 04期
关键词
time series forecasting; financial forecasting; recurrent neural network; LSTM BiLSTM; transformer; EMD; NEURAL-NETWORK; DECOMPOSITION; ELECTRICITY; PREDICTION; ENERGY; WIND;
D O I
10.3934/math.2024459
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
The adjusted precision of economic values is essential in the global economy. In recent years, researchers have increased their interest in making accurate predictions in this type of time series; one of the reasons is that the characteristics of this type of time series makes predicting a complicated task due to its non-linear nature. The evolution of artificial neural network models enables us to research the suitability of models generated for other purposes, applying their potential to time series prediction with promising results. Specifically, in this field, the application of transformer models is assuming an innovative approach with great results. To improve the performance of this type of networks, in this work, the empirical model decomposition (EMD) methodology was used as data preprocessing for prediction with a transformer type network. The results confirmed a better performance of this approach compared to networks widely used in this field, the bidirectional long short term memory (BiLSTM), and long short term memory (LSTM) networks using and without EMD preprocessing, as well as the comparison of a Transformer network without applying EMD to the data, with a lower error in all the error metrics used: The root mean square error (RMSE), the root mean square error (MSE), the mean absolute percentage error (MAPE), and the R -square (R2). Finding a model that provides results that improve the literature allows for a greater adjustment in the predictions with minimal preprocessing.
引用
收藏
页码:9419 / 9434
页数:16
相关论文
共 53 条
[1]  
Beck J. V., 1977, Parameter estimation in engineering and science, DOI [10.2307/1403212, DOI 10.2307/1403212]
[2]   A comparative study of wavelet-based ANN and classical techniques for geophysical time-series forecasting [J].
Bhardwaj, Shivam ;
Chandrasekhar, E. ;
Padiyar, Priyanka ;
Gadre, Vikram M. .
COMPUTERS & GEOSCIENCES, 2020, 138
[3]   A COVID-19 time series forecasting model based on MLP ANN [J].
Borghi, Pedro Henrique ;
Zakordonets, Oleksandr ;
Teixeira, Joao Paulo .
INTERNATIONAL CONFERENCE ON ENTERPRISE INFORMATION SYSTEMS / INTERNATIONAL CONFERENCE ON PROJECT MANAGEMENT / INTERNATIONAL CONFERENCE ON HEALTH AND SOCIAL CARE INFORMATION SYSTEMS AND TECHNOLOGIES 2020 (CENTERIS/PROJMAN/HCIST 2020), 2021, 181 :940-947
[4]  
Chen SA, 2023, Arxiv, DOI [arXiv:2303.06053, DOI 10.48550/ARXIV.2303.06053]
[5]   Multi-scale temporal features extraction based graph convolutional network with attention for multivariate time series prediction [J].
Chen, Yawen ;
Ding, Fengqian ;
Zhai, Linbo .
EXPERT SYSTEMS WITH APPLICATIONS, 2022, 200
[6]   High Precision LSTM Model for Short-Time Load Forecasting in Power Systems [J].
Ciechulski, Tomasz ;
Osowski, Stanislaw .
ENERGIES, 2021, 14 (11)
[7]  
Contreras J, 2002, IEEE Power Eng. Rev., V22, P57, DOI [10.1109/MPER.2002.4312577, DOI 10.1109/MPER.2002.4312577]
[8]  
Devlin J, 2019, 2019 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES (NAACL HLT 2019), VOL. 1, P4171
[9]   An artificial neural network-based forecasting model of energy-related time series for electrical grid management [J].
Di Piazza, A. ;
Di Piazza, M. C. ;
La Tona, G. ;
Luna, M. .
MATHEMATICS AND COMPUTERS IN SIMULATION, 2021, 184 :294-305
[10]  
Dosovitskiy A, 2021, Arxiv, DOI arXiv:2010.11929