TimeDDPM: Time Series Augmentation Strategy for Industrial Soft Sensing

被引:26
作者
Dai, Yun [1 ]
Yang, Chao [2 ]
Liu, Kaixin [3 ]
Liu, Angpeng [1 ]
Liu, Yi [1 ]
机构
[1] Zhejiang Univ Technol, Inst Proc Equipment & Control Engn, Hangzhou 310023, Peoples R China
[2] Northeastern Univ, State Key Lab Synthet Automat Proc Ind, Shenyang 110819, Peoples R China
[3] North Univ China, Shanxi Key Lab Signal Capturing & Proc, Taiyuan 030051, Peoples R China
基金
中国国家自然科学基金;
关键词
Hidden Markov models; Soft sensors; Data models; Training; Logic gates; Diffusion processes; Training data; Convolutional neural network; diffusion model; dynamic process; long short-term memory (LSTM); soft sensor; SENSOR;
D O I
10.1109/JSEN.2023.3339245
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Soft sensor modeling for dynamic processes has become a trending topic and a pending challenge in industrial data analysis, especially in limited labeled data scenarios. Alternatively, data augmentation strategies provide a way to address the deficiency of samples. However, current time-series data augmentation methods do not consider the spatiotemporal dependencies among samples during the data generation procedure. To address the issue, a time-series denoising diffusion probabilistic model (TimeDDPM) is proposed to construct a soft sensor for finite time-series samples. First, the long short-term memory (LSTM) units and 1-D convolutional neural networks are implemented in the noise prediction network of TimeDDPM to mine both temporal and spatial properties of samples. Then, virtual samples are reconstructed step by step in the reverse process to enlarge the sample space of insufficient data. Finally, based on the augmented samples, the LSTM network is constructed as a base model to evaluate the quality of new training data. Two cases are employed to demonstrate the superiorities of the proposed method in comparison to several cutting-edge methods.
引用
收藏
页码:2145 / 2153
页数:9
相关论文
共 36 条
[1]  
Cao HQ, 2023, Arxiv, DOI [arXiv:2209.02646, 10.48550/arXiv.2209.02646]
[2]   Flexible Clockwork Recurrent Neural Network for multirate industrial soft sensor [J].
Chang, Shuchao ;
Chen, Xu ;
Zhao, Chunhui .
JOURNAL OF PROCESS CONTROL, 2022, 119 :86-100
[3]  
Chu C., 2020, PROC INT C LEARN REP, P1
[4]   Diffusion Models in Vision: A Survey [J].
Croitoru, Florinel-Alin ;
Hondru, Vlad ;
Ionescu, Radu Tudor ;
Shah, Mubarak .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (09) :10850-10869
[5]  
Desai A., 2022, PROC INT C LEARN REP, P1
[6]  
Fortuna L, 2007, ADV IND CONTROL, P1, DOI 10.1007/978-1-84628-480-9
[7]   A reduced order soft sensor approach and its application to a continuous digester [J].
Galicia, Hector J. ;
He, Q. Peter ;
Wang, Jin .
JOURNAL OF PROCESS CONTROL, 2011, 21 (04) :489-500
[8]   SVAE-WGAN-Based Soft Sensor Data Supplement Method for Process Industry [J].
Gao, Shiwei ;
Qiu, Sulong ;
Ma, Zhongyu ;
Tian, Ran ;
Liu, Yanxing .
IEEE SENSORS JOURNAL, 2022, 22 (01) :601-610
[9]   PARTIAL LEAST-SQUARES REGRESSION - A TUTORIAL [J].
GELADI, P ;
KOWALSKI, BR .
ANALYTICA CHIMICA ACTA, 1986, 185 :1-17
[10]   A Data-Driven Soft Sensor to Forecast Energy Consumption in Wastewater Treatment Plants: A Case Study [J].
Harrou, Fouzi ;
Cheng, Tuoyuan ;
Sun, Ying ;
Leiknes, TorOve ;
Ghaffour, Noreddine .
IEEE SENSORS JOURNAL, 2021, 21 (04) :4908-4917