Soft sensor modeling based on masked convolutional transformer block deep residual shrinkage network

被引:1
作者
Gao, Shiwei [1 ]
Li, Tianzhen [1 ]
Dong, Xiaohui [1 ]
机构
[1] Northwest Normal Univ, Sch Comp Sci & Engn, Lanzhou, Gansu Province, Peoples R China
基金
中国国家自然科学基金;
关键词
Deep learning; Masked convolution; Transformer; Attention mechanism; Soft sensor; NEURAL-NETWORK;
D O I
10.1016/j.jtice.2024.105666
中图分类号
TQ [化学工业];
学科分类号
0817 ;
摘要
Background: Data-driven soft sensor technology is currently an important means for industrial data prediction, addressing the challenge of predicting key quality variables in industrial production processes. Convolutional neural networks (CNN) are widely applied in soft sensor modeling due to their excellent nonlinear modeling and feature extraction capabilities. However, CNN also faces several issues, such as poor robustness to interference and difficulties in extracting features from complex process data. Methods: This paper introduces a novel CNN model called the Masked Convolutional Transformer Block Deep Residual Shrinkage Network (MCTB-DRSN). Firstly, the Masked Convolutional Transformer Block (MCTB) is utilized to extract features from different positions, thereby enabling the network model to focus more on important information. Secondly, the Global Response Normalization (GRN) layer is incorporated into the Deep Residual Shrinkage Network (DRSN) module, which enhances feature competition among channels. Significant Findings: This method can provide effective monitoring for chemical production process. Compared with the traditional soft sensor method on the debutanizer column dataset, the results show that the prediction accuracy of this model is significantly improved.
引用
收藏
页数:8
相关论文
共 24 条
  • [1] A virtual sample generation method based on manifold learning and a generative adversarial network for soft sensor models with limited data
    Bai, Xinpeng
    Li, Shaojun
    [J]. JOURNAL OF THE TAIWAN INSTITUTE OF CHEMICAL ENGINEERS, 2023, 151
  • [2] A soft sensor regression model for complex chemical process based on generative adversarial nets and vine copula
    Chen, Hongmin
    Jiao, Ling
    Li, Shaojun
    [J]. JOURNAL OF THE TAIWAN INSTITUTE OF CHEMICAL ENGINEERS, 2022, 138
  • [3] Knowledge Automation Through Graph Mining, Convolution, and Explanation Framework: A Soft Sensor Practice
    Chen, Zhichao
    Ge, Zhiqiang
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2022, 18 (09) : 6068 - 6078
  • [4] Soft sensors for product quality monitoring in debutanizer distillation columns
    Fortuna, L
    Graziani, S
    Xibilia, MG
    [J]. CONTROL ENGINEERING PRACTICE, 2005, 13 (04) : 499 - 508
  • [5] Research on Modeling of Industrial Soft Sensor Based on Ensemble Learning
    Gao, Shiwei
    Xu, Jinpeng
    Ma, Zhongyu
    Tian, Ran
    Dang, Xiaochao
    Dong, Xiaohui
    [J]. IEEE SENSORS JOURNAL, 2024, 24 (09) : 14380 - 14391
  • [6] Collaborative Apportionment Noise-Based Soft Sensor Framework
    Gao, Shiwei
    Zhang, Qingsong
    Tian, Ran
    Ma, Zhongyu
    Liu, Yanxing
    Hao, Ziqian
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71
  • [7] Horizontal Data Augmentation Strategy for Industrial Quality Prediction
    Gao, Shiwei
    Zhang, Qingsong
    Tian, Ran
    Ma, Zhongyu
    Dang, Xiaochao
    [J]. ACS OMEGA, 2022, 7 (35): : 30782 - 30793
  • [8] Novel Transformer Based on Gated Convolutional Neural Network for Dynamic Soft Sensor Modeling of Industrial Processes
    Geng, Zhiqiang
    Chen, Zhiwei
    Meng, Qingchao
    Han, Yongming
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2022, 18 (03) : 1521 - 1529
  • [9] Production capacity analysis and energy saving of complex chemical processes using LSTM based on attention mechanism
    Han, Yongming
    Fan, Chenyu
    Xu, Meng
    Geng, Zhiqiang
    Zhong, Yanhua
    [J]. APPLIED THERMAL ENGINEERING, 2019, 160
  • [10] Semi-supervised ensemble support vector regression based soft sensor for key quality variable estimation of nonlinear industrial processes with limited labeled data
    Li, Zheng
    Jin, Huaiping
    Dong, Shoulong
    Qian, Bin
    Yang, Biao
    Chen, Xiangguang
    [J]. CHEMICAL ENGINEERING RESEARCH & DESIGN, 2022, 179 : 510 - 526