Neural Network Based on Windowed Convolutional Transformation to Extract Features in Time Domain and Its Application on Soft Sensing

被引:0
作者
Lu, Yusheng [1 ]
Yang, Dan [1 ]
Li, Zhongmei [1 ]
Peng, Xin [1 ]
Zhong, Weimin [1 ]
机构
[1] East China Univ Sci & Technol, Key Lab Smart Mfg Energy Chem Proc, Shanghai 200237, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Convolution; Soft sensors; Predictive models; Delay effects; Time-domain analysis; Ordinary differential equations; Deep learning; neural network; neural ordinary differential equations; soft sensing; time delay; PREDICTION; REGRESSION; MACHINE; MODELS; SENSOR;
D O I
10.1109/TIM.2022.3180405
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In soft sensing, quality indicators are predicted by the signals of the discrete process variables in the time domain, in which the time delay exists in the process variables and quality indicators. Traditionally, discrete variables are used to estimate quality indicators directly through the time-series model, in which the sliding window is used to extract time-series features of the process signals. As discrete variables can be served as samples of a continuous function, this article proposes a soft sensing method whose inputs follow a continuous function. The continuous function is estimated by discrete variables and used to estimate quality indicators. Meanwhile, in the time-series model, the features extracted by the signals within the sliding window are inconsistent with the ones with all the historical signals, and thus, the time-series model lacks interpretability. To make a consistent prediction when the length of the time-series signals changes, this article proposes the windowed convolutional transformation to extract the features of the evaluated continuous function of discrete inputs. Besides, the proposed windowed convolutional transformation can automatically deal with the time delay in the process variables and quality indicators. To effectively calculate the gradients of the windowed convolutional transformation, a memory-efficient gradient estimation method for neural ordinary differential equations with inputs is designed. Finally, a soft-sensing method based on windowed convolutional transformation is proposed.
引用
收藏
页数:13
相关论文
共 31 条
[1]  
[Anonymous], 2018, IEEE T IND INFORM, DOI [10.1109/TII.2018.2809730, DOI 10.1109/TII.2018.2809730]
[2]  
Butcher JC, 1987, NUMERICAL ANAL ORDIN
[3]  
Chen R T Q., 2018, ADV NEURAL INFORM PR, Vvol 31
[4]   Key performance index estimation based on ensemble locally weighted partial least squares and its application on industrial nonlinear processes [J].
Chen, Xin ;
Zhong, Weimin ;
Jiang, Chao ;
Li, Zhi ;
Peng, Xin ;
Cheng, Hui .
CHEMOMETRICS AND INTELLIGENT LABORATORY SYSTEMS, 2020, 203
[5]  
Cho K, 2014, ARXIV14061078, P1724
[6]   Dual Attention-Based Encoder-Decoder: A Customized Sequence-to-Sequence Learning for Soft Sensor Development [J].
Feng, Liangjun ;
Zhao, Chunhui ;
Sun, Youxian .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2021, 32 (08) :3306-3317
[7]   Process Data Analytics via Probabilistic Latent Variable Models: A Tutorial Review [J].
Ge, Zhiqiang .
INDUSTRIAL & ENGINEERING CHEMISTRY RESEARCH, 2018, 57 (38) :12646-12661
[8]   Semisupervised Bayesian Method for Soft Sensor Modeling with Unlabeled Data Samples [J].
Ge, Zhiqiang ;
Song, Zhihuan .
AICHE JOURNAL, 2011, 57 (08) :2109-2119
[9]   Learning to forget: Continual prediction with LSTM [J].
Gers, FA ;
Schmidhuber, J ;
Cummins, F .
NEURAL COMPUTATION, 2000, 12 (10) :2451-2471
[10]  
Gholami A., 2019, ARXIV190210298