Attention-Based Deep Recurrent Neural Network to Forecast the Temperature Behavior of an Electric Arc Furnace Side-Wall

被引:11
作者
Godoy-Rojas, Diego F. [1 ]
Leon-Medina, Jersson X. [2 ,3 ]
Rueda, Bernardo [4 ]
Vargas, Whilmar [4 ]
Romero, Juan [4 ]
Pedraza, Cesar [5 ]
Pozo, Francesc [2 ,6 ]
Tibaduiza, Diego A. [1 ]
机构
[1] Univ Nacl Colombia, Dept Ingn Elect & Elect, Cra 45 26-85, Bogota 111321, Colombia
[2] Univ Politecn Catalunya UPC, Campus Diagonal Besos CDB, Dept Math,Escola Engn Barcelona Est EEBE, Control Modeling Identificat & Applicat CoDAlab, Eduard Maristany 16, Barcelona 08019, Spain
[3] Univ Nacl Colombia, Dept Ingn Mecan & Mecatron, Cra 45 26-85, Bogota 111321, Colombia
[4] South32 Cerro Matoso SA, Km 22 Highway SO Montelibano, Cordoba 234001, Colombia
[5] Univ Nacl Colombia, Dept Ingn Sistemas & Ind, Cra 45 26-85, Bogota 111321, Colombia
[6] Univ Politecn Catalunya UPC, Inst Math IMTech, Pau Gargallo 14, Barcelona 08028, Spain
关键词
structural health monitoring; temperature forecasting; recurrent neural network; attention; GRU; LSTM; electric arc furnace; PREDICTION;
D O I
10.3390/s22041418
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Structural health monitoring (SHM) in an electric arc furnace is performed in several ways. It depends on the kind of element or variable to monitor. For instance, the lining of these furnaces is made of refractory materials that can be worn out over time. Therefore, monitoring the temperatures on the walls and the cooling elements of the furnace is essential for correct structural monitoring. In this work, a multivariate time series temperature prediction was performed through a deep learning approach. To take advantage of data from the last 5 years while not neglecting the initial parts of the sequence in the oldest years, an attention mechanism was used to model time series forecasting using deep learning. The attention mechanism was built on the foundation of the encoder-decoder approach in neural networks. Thus, with the use of an attention mechanism, the long-term dependency of the temperature predictions in a furnace was improved. A warm-up period in the training process of the neural network was implemented. The results of the attention-based mechanism were compared with the use of recurrent neural network architectures to deal with time series data, such as Long Short-Term Memory (LSTM) and Gated Recurrent Unit (GRU). The results of the Average Root Mean Square Error (ARMSE) obtained with the attention-based mechanism were the lowest. Finally, a variable importance study was performed to identify the best variables to train the model.
引用
收藏
页数:20
相关论文
共 33 条
[1]  
Anaya M., 2016, THESIS U POLITECNICA
[2]  
[Anonymous], ARXIV150804025, DOI DOI 10.18653/V1/2021.FNDINGSEMNLP.101
[3]   Benchmarking Attention-Based Interpretability of Deep Learning in Multivariate Time Series Predictions [J].
Baric, Domjan ;
Fumic, Petar ;
Horvatic, Davor ;
Lipic, Tomislav .
ENTROPY, 2021, 23 (02) :1-23
[4]  
BONTEMPI G, 2013, TUTORIAL LECT P BUSI, P62, DOI DOI 10.1007/978-3-642-36318-4_3
[5]  
Camacho-Olarte J., 2020, Eng. Proc., V2, P21, DOI 10.3390/ecsa-7-08245
[6]   Structural health monitoring techniques for aircraft composite structures [J].
Diamanti, K. ;
Soutis, C. .
PROGRESS IN AEROSPACE SCIENCES, 2010, 46 (08) :342-352
[7]   A Hybrid Distribution Feeder Long-Term Load Forecasting Method Based on Sequence Prediction [J].
Dong, Ming ;
Grumbach, Lukas .
IEEE TRANSACTIONS ON SMART GRID, 2020, 11 (01) :470-482
[8]   Multivariate time series forecasting via attention-based encoder-decoder framework [J].
Du, Shengdong ;
Li, Tianrui ;
Yang, Yan ;
Horng, Shi-Jinn .
NEUROCOMPUTING, 2020, 388 :269-279
[9]   Decision support system for integrating remote sensing in bridge condition assessment and preservation [J].
Endsley, Arthur ;
Brooks, Colin ;
Harris, Devin ;
Ahlborn, Tess ;
Vaghefi, Khatereh .
SENSORS AND SMART STRUCTURES TECHNOLOGIES FOR CIVIL, MECHANICAL, AND AEROSPACE SYSTEMS 2012, PTS 1 AND 2, 2012, 8345
[10]   Reliability prediction of bridges based on monitored data and Bayesian dynamic models [J].
Fan, Xueping ;
Lu, Dagang .
Key Engineering Materials, 2014, 574 :77-84