Improving Visual Defect Detection and Localization in Industrial Thermal Images Using Autoencoders

被引:2
作者
Behrouzi, Sasha [1 ]
Dix, Marcel [2 ]
Karampanah, Fatemeh [1 ]
Ates, Omer [1 ]
Sasidharan, Nissy [1 ]
Chandna, Swati [1 ]
Vu, Binh [1 ]
机构
[1] SRH Univ, Appl Data Sci & Analyt, D-69123 Heidelberg, Germany
[2] ABB Corp Res, Ind Data Analyt, D-68526 Ladenburg, Germany
关键词
anomaly detection; deep learning; novelty detection; autoencoder; industrial image; thermal image;
D O I
10.3390/jimaging9070137
中图分类号
TB8 [摄影技术];
学科分类号
0804 ;
摘要
Reliable functionality in anomaly detection in thermal image datasets is crucial for defect detection of industrial products. Nevertheless, achieving reliable functionality is challenging, especially when datasets are image sequences captured during equipment runtime with a smooth transition from healthy to defective images. This causes contamination of healthy training data with defective samples. Anomaly detection methods based on autoencoders are susceptible to a slight violation of a clean training dataset and lead to challenging threshold determination for sample classification. This paper indicates that combining anomaly scores leads to better threshold determination that effectively separates healthy and defective data. Our research results show that our approach helps to overcome these challenges. The autoencoder models in our research are trained with healthy images optimizing two loss functions: mean squared error (MSE) and structural similarity index measure (SSIM). Anomaly score outputs are used for classification. Three anomaly scores are applied: MSE, SSIM, and kernel density estimation (KDE). The proposed method is trained and tested on the 32 x 32-sized thermal images, including one contaminated dataset. The model achieved the following average accuracies across the datasets: MSE, 95.33%; SSIM, 88.37%; and KDE, 92.81%. Using a combination of anomaly scores could assist in solving a low classification accuracy. The use of KDE improves performance when healthy training data are contaminated. The MSE+ and SSIM+ methods, as well as two parameters to control quantitative anomaly localization using SSIM, are introduced.
引用
收藏
页数:14
相关论文
共 27 条
  • [1] Akcay S, 2018, Arxiv, DOI [arXiv:1805.06725, DOI 10.48550/ARXIV.1805.06725]
  • [2] An J., 2015, SPECIAL LECT IE, V2, P1, DOI DOI 10.1007/BF00758335
  • [3] Bank D., 2020, arXiv
  • [4] Beggel L, 2019, Arxiv, DOI arXiv:1901.06355
  • [5] Bergmann P, 2019, Arxiv, DOI arXiv:1807.02011
  • [6] Deep Feature Learning for Medical Image Analysis with Convolutional Autoencoder Neural Network
    Chen, Min
    Shi, Xiaobo
    Zhang, Yin
    Wu, Di
    Guizani, Mohsen
    [J]. IEEE TRANSACTIONS ON BIG DATA, 2021, 7 (04) : 750 - 758
  • [7] Anomaly detection of defects on concrete structures with the convolutional autoencoder
    Chow, J. K.
    Su, Z.
    Wu, J.
    Tan, P. S.
    Mao, X.
    Wang, Y. H.
    [J]. ADVANCED ENGINEERING INFORMATICS, 2020, 45 (45)
  • [8] Di Mattia F, 2021, Arxiv, DOI [arXiv:1906.11632, 10.48550/ARXIV.1906.11632]
  • [9] Donahue J, 2016, arXiv, DOI DOI 10.48550/ARXIV.1605.09782
  • [10] Feeney P., 2021, arXiv