Optimized deep networks structure to improve the accuracy of estimator algorithm in deep networks learning

被引:0
作者
Nezhad, H. Rezaei [1 ]
Keynia, F. [2 ]
Molahosseini, A. Sabbagh [1 ,3 ]
机构
[1] Islamic Azad Univ, Dept Comp, Kerman Branch, Kerman, Iran
[2] Grad Univ Adv Technol, Inst Sci & High Technol & Environm Sci, Dept Energy Management & Optimizat, Kerman, Iran
[3] Queens Univ Belfast, Sch Elect Elect Engn & Comp Sci, Belfast, North Ireland
关键词
Optimization algorithm; Time series; Estimation; Prediction; Convolutional neuralnetwork; Long short-term memory; NEURAL-NETWORK; TIME-SERIES;
D O I
10.24200/sci.2023.62337.7782
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
The present study considers decreasing prediction error for various types of time series and the uncertainty in estimation parameters, improving the structure of the Deep Neural Network (DNN), and increasing response speed in the proposed neural network method. Additionally, the competitive performance and the collaboration among the neurons of the DNN are also increased. The selected data is related to weather prediction for Qeshm, which has suitable weather conditions for our study, spanning from 2016 onwards. Tn this study, to analyze the prediction issue of power consumption of domestic expenses in the indefinite and severe fluctuation mode, we decided to combine the two methods of Long Short-Term Memory (LSTM) and Convolutional Neural Network (CNN). For the training of the deep network, the Rack Propagation (RP) algorithm is used. The results indicate that Gated Recurrent Unit (GRU) networks compared to other models (MultiLayer Perceptrons (MLP), CNN, and DNN) produce more realistic results, and also twoway networks obtained better results on test data compared to LSTM networks. Root Mean Square Error (RMSE) prediction is more realistic than the LSTM model on test and training data against significant data. A GRU network has two gates of rt readjust and Zt forgetting, which helps to ensure that long-term dependencies of gradient fading will not occur. (c) 2024 Sharif University of Technology. All rights reserved.
引用
收藏
页码:417 / 429
页数:13
相关论文
共 29 条