A Novel Deep Learning Representation for Industrial Control System Data

被引:0
作者
Zhang, Bowen [1 ,2 ,3 ]
Shi, Yanbo [4 ]
Zhao, Jianming [1 ,2 ,3 ]
Wang, Tianyu [1 ,2 ,3 ]
Wang, Kaidi [5 ]
机构
[1] Chinese Acad Sci, Key Lab Networked Control Syst, Shenyang 110016, Peoples R China
[2] Chinese Acad Sci, Shenyang Inst Automat, Shenyang 110016, Peoples R China
[3] Chinese Acad Sci, Inst Robot & Intelligent Mfg, Shenyang 110169, Peoples R China
[4] Shenyang Aircraft Corp, Shenyang 110850, Peoples R China
[5] Molarray Res, Toronto, ON L4B 3K1, Canada
关键词
Industrial control system; machine learning; deep learning; autoencoder; PRINCIPAL COMPONENT ANALYSIS; DIMENSIONALITY REDUCTION; CLASSIFICATION;
D O I
10.32604/iasc.2023.033762
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Feature extraction plays an important role in constructing artificial intelligence (AI) models of industrial control systems (ICSs). Three challenges in this field are learning effective representation from high-dimensional features, data heterogeneity, and data noise due to the diversity of data dimensions, formats and noise of sensors, controllers and actuators. Hence, a novel unsupervised learning autoencoder model is proposed for ICS data in this paper. Although traditional methods only capture the linear correlations of ICS features, our deep industrial representation learning model (DIRL) based on a convolutional neural network can mine high-order features, thus solving the problem of high-dimensional and heterogeneous ICS data. In addition, an unsupervised denoising autoencoder is introduced for noisy ICS data in DIRL. Training the denoising autoencoder allows the model to better mitigate the sensor noise problem. In this way, the representative features learned by DIRL could help to evaluate the safety state of ICSs more effectively. We tested our model with absolute and relative accuracy experiments on two large-scale ICS datasets. Compared with other popular methods, DIRL showed advantages in four common indicators of AI algorithms: accuracy, precision, recall, and F1-score. This study contributes to the effective analysis of large-scale ICS data, which promotes the stable operation of ICSs.
引用
收藏
页码:2703 / 2717
页数:15
相关论文
共 26 条
  • [1] A comparative dimensionality reduction study in telecom customer segmentation using deep learning and PCA
    Alkhayrat, Maha
    Aljnidi, Mohamad
    Aljoumaa, Kadan
    [J]. JOURNAL OF BIG DATA, 2020, 7 (01)
  • [2] NEURAL NETWORKS AND PRINCIPAL COMPONENT ANALYSIS - LEARNING FROM EXAMPLES WITHOUT LOCAL MINIMA
    BALDI, P
    HORNIK, K
    [J]. NEURAL NETWORKS, 1989, 2 (01) : 53 - 58
  • [3] Representation Learning: A Review and New Perspectives
    Bengio, Yoshua
    Courville, Aaron
    Vincent, Pascal
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2013, 35 (08) : 1798 - 1828
  • [4] Robustness-Driven Feature Selection in Classification of Fibrotic Interstitial Lung Disease Patterns in Computed Tomography Using 3D Texture Features
    Chong, Daniel Y.
    Kim, Hyun J.
    Lo, Pechin
    Young, Stefano
    McNitt-Gray, Michael F.
    Abtin, Fereidoun
    Goldin, Jonathan G.
    Brown, Matthew S.
    [J]. IEEE TRANSACTIONS ON MEDICAL IMAGING, 2016, 35 (01) : 144 - 157
  • [5] Stacked sparse autoencoder and history of binary motion image for human activity recognition
    Gnouma, Mariem
    Ladjailia, Ammar
    Ejbali, Ridha
    Zaied, Mourad
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2019, 78 (02) : 2157 - 2179
  • [6] DISCRIMINANT-ANALYSIS
    HUBERTY, CJ
    [J]. REVIEW OF EDUCATIONAL RESEARCH, 1975, 45 (04) : 543 - 598
  • [7] Detecting cyberattacks using anomaly detection in industrial control systems: A Federated Learning approach
    Huong, Truong Thu
    Bac, Ta Phuong
    Long, Dao Minh
    Luong, Tran Duc
    Dan, Nguyen Minh
    Quang, Le Anh
    Cong, Le Thanh
    Thang, Bui Doan
    Tran, Kim Phuc
    [J]. COMPUTERS IN INDUSTRY, 2021, 132 (132)
  • [8] Mining electronic health records: towards better research applications and clinical care
    Jensen, Peter B.
    Jensen, Lars J.
    Brunak, Soren
    [J]. NATURE REVIEWS GENETICS, 2012, 13 (06) : 395 - 405
  • [9] Five-category classification of pathological brain images based on deep stacked sparse autoencoder
    Jia, Wenjuan
    Muhammad, Khan
    Wang, Shui-Hua
    Zhang, Yu-Dong
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2019, 78 (04) : 4045 - 4064
  • [10] Industrial Anomaly Detection and Attack Classification Method Based on Convolutional Neural Network
    Lai, Yingxu
    Zhang, Jingwen
    Liu, Zenghui
    [J]. SECURITY AND COMMUNICATION NETWORKS, 2019, 2019