Dynamic historical information incorporated attention deep learning model for industrial soft sensor modeling

被引:46
作者
Wang, Yalin [1 ]
Liu, Diju [1 ]
Liu, Chenliang [1 ]
Yuan, Xiaofeng [1 ]
Wang, Kai [1 ]
Yang, Chunhua [1 ]
机构
[1] Cent South Univ, Sch Automat, Changsha 410083, Hunan, Peoples R China
基金
中国国家自然科学基金;
关键词
Soft sensor; Deep learning; Stacked autoencoder; Attention mechanism; AD-SAE; SUPPORT VECTOR REGRESSION; PREDICTION; FRAMEWORK;
D O I
10.1016/j.aei.2022.101590
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Due to the limitations of sampling conditions and sampling techniques in many real industrial processes, the process data under different sampling conditions subject to different sampling frequencies, which leads to irregular interval sampling characteristics of the entire process data. The dynamic historical data information reflecting the production status under irregular sampling frequency has an important influence on the performance of data feature extraction. However, the existing soft sensor modeling methods based on deep learning do not consider introducing dynamic historical information into the feature extraction process. To combat this issue, a novel attention-based dynamic stacked autoencoder networks (AD-SAE) for soft sensor modeling is proposed in this paper. First, the sliding window technology and attention mechanism based on position coding are introduced to select dynamic historical samples and calculate the contribution of different historical samples to the current sample, respectively. Then, AD-SAE combines obtained historical sample information and current sample information as the input of the network for deep feature extraction and industrial soft sensor modeling. The experimental results on the actual hydrocracking process data set show that the proposed method has better performance than traditional methods.
引用
收藏
页数:15
相关论文
共 32 条
[1]   A Novel Scheme for Key Performance Indicator Prediction and Diagnosis With Application to an Industrial Hot Strip Mill [J].
Ding, Steven X. ;
Yin, Shen ;
Peng, Kaixiang ;
Hao, Haiyang ;
Shen, Bo .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2013, 9 (04) :2239-2247
[2]   Defective wafer detection using a denoising autoencoder for semiconductor manufacturing processes [J].
Fan, Shu-Kai S. ;
Hsu, Chia-Yu ;
Jen, Chih-Hung ;
Chen, Kuan-Lung ;
Juan, Li-Ting .
ADVANCED ENGINEERING INFORMATICS, 2020, 46
[3]   Soft sensors for product quality monitoring in debutanizer distillation columns [J].
Fortuna, L ;
Graziani, S ;
Xibilia, MG .
CONTROL ENGINEERING PRACTICE, 2005, 13 (04) :499-508
[4]   Dynamic Probabilistic Latent Variable Model for Process Data Modeling and Regression Application [J].
Ge, Zhiqiang ;
Chen, Xinru .
IEEE TRANSACTIONS ON CONTROL SYSTEMS TECHNOLOGY, 2019, 27 (01) :323-331
[5]   Review of Recent Research on Data-Based Process Monitoring [J].
Ge, Zhiqiang ;
Song, Zhihuan ;
Gao, Furong .
INDUSTRIAL & ENGINEERING CHEMISTRY RESEARCH, 2013, 52 (10) :3543-3562
[6]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[7]   A fast learning algorithm for deep belief nets [J].
Hinton, Geoffrey E. ;
Osindero, Simon ;
Teh, Yee-Whye .
NEURAL COMPUTATION, 2006, 18 (07) :1527-1554
[8]   A Review on Soft Sensors for Monitoring, Control, and Optimization of Industrial Processes [J].
Jiang, Yuchen ;
Yin, Shen ;
Dong, Jingwei ;
Kaynak, Okyay .
IEEE SENSORS JOURNAL, 2021, 21 (11) :12868-12881
[9]   Review of adaptation mechanisms for data-driven soft sensors [J].
Kadlec, Petr ;
Grbic, Ratko ;
Gabrys, Bogdan .
COMPUTERS & CHEMICAL ENGINEERING, 2011, 35 (01) :1-24
[10]   Data-driven Soft Sensors in the process industry [J].
Kadlec, Petr ;
Gabrys, Bogdan ;
Strandt, Sibylle .
COMPUTERS & CHEMICAL ENGINEERING, 2009, 33 (04) :795-814