A Generic Automated Surface Defect Detection Based on a Bilinear Model

被引:39
作者
Zhou, Fei [1 ]
Liu, Guihua [1 ]
Xu, Feng [1 ]
Deng, Hao [1 ]
机构
[1] Southwest Univ Sci & Technol, Sch Informat Engn, Mianyang 621010, Sichuan, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2019年 / 9卷 / 15期
基金
中国国家自然科学基金;
关键词
automated surface inspection; D-VGG16; bilinear model; Grad-CAM; classification; localization;
D O I
10.3390/app9153159
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
Aiming at the problems of complex texture, variable interference factors and large sample acquisition in surface defect detection, a generic method of automated surface defect detection based on a bilinear model was proposed. To realize the automatic classification and localization of surface defects, a new Double-Visual Geometry Group16 (D-VGG16) is firstly designed as feature functions of the bilinear model. The global and local features fully extracted from the bilinear model by D-VGG16 are output to the soft-max function to realize the automatic classification of surface defects. Then the heat map of the original image is obtained by applying Gradient-weighted Class Activation Mapping (Grad-CAM) to the output features of D-VGG16. Finally, the defects in the original input image can be located automatically after processing the heat map with a threshold segmentation method. The training process of the proposed method is characterized by a small sample, end-to-end, and is weakly-supervised. Furthermore, experiments are performed on two public and two industrial datasets, which have different defective features in texture, shape and color. The results show that the proposed method can simultaneously realize the classification and localization of defects with different defective features. The average precision of the proposed method is above 99% on the four datasets, and is higher than the known latest algorithms.
引用
收藏
页数:17
相关论文
共 34 条
  • [1] Solid subtraction model for the surface topography prediction in flank milling of thin-walled integral blade rotors (IBRs)
    Artetxe, E.
    Olvera, Dv.
    Lopez de Lacalle, L. N.
    Campa, F. J.
    Olvera, Dn.
    Lamikiz, A.
    [J]. INTERNATIONAL JOURNAL OF ADVANCED MANUFACTURING TECHNOLOGY, 2017, 90 (1-4) : 741 - 752
  • [2] Autonomous Structural Visual Inspection Using Region-Based Deep Learning for Detecting Multiple Damage Types
    Cha, Young-Jin
    Choi, Wooram
    Suh, Gahyun
    Mahmoudkhani, Sadegh
    Buyukozturk, Oral
    [J]. COMPUTER-AIDED CIVIL AND INFRASTRUCTURE ENGINEERING, 2018, 33 (09) : 731 - 747
  • [3] Inspection scheduling based on reliability updating of gas turbine welded structures
    Coro, Armando
    Abasolo, Mikel
    Aguirrebeitia, Josu
    Lopez de Lacalle, L. N.
    [J]. ADVANCES IN MECHANICAL ENGINEERING, 2019, 11 (01)
  • [4] Feng W, 2019, ARXIV PREPRINT ARXIV
  • [5] Automatic Defect Detection on Hot-Rolled Flat Steel Products
    Ghorai, Santanu
    Mukherjee, Anirban
    Gangadaran, M.
    Dutta, Pranab K.
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2013, 62 (03) : 612 - 621
  • [6] Surface defect classification of steels with a new semi-supervised learning method
    He Di
    Xu Ke
    Zhou Peng
    Zhou Dongdong
    [J]. OPTICS AND LASERS IN ENGINEERING, 2019, 117 : 40 - 48
  • [7] Kingma D. P., 2014, P INT C LEARN REP BA, P1
  • [8] A Simulation-based Research on Emergency Pedestrian Evacuation for Urban Residential Districts
    Li Shuang
    Deng Wei
    Lv Yisheng
    [J]. 2009 INTERNATIONAL CONFERENCE ON MEASURING TECHNOLOGY AND MECHATRONICS AUTOMATION, VOL II, 2009, : 200 - +
  • [9] Disconnected covariance of 2-point functions in large-scale structure
    Li, Yin
    Singh, Sukhdeep
    Yu, Byeonghee
    Feng, Yu
    Seljak, Uros
    [J]. JOURNAL OF COSMOLOGY AND ASTROPARTICLE PHYSICS, 2019, (01):
  • [10] Automated defect inspection of LED chip using deep convolutional neural network
    Lin, Hui
    Li, Bin
    Wang, Xinggang
    Shu, Yufeng
    Niu, Shuanglong
    [J]. JOURNAL OF INTELLIGENT MANUFACTURING, 2019, 30 (06) : 2525 - 2534