Efficient online surface defect detection using multiple instance learning

被引:1
作者
Xu, Guang [1 ]
Ren, Ming [1 ]
Li, Guozhi [2 ]
机构
[1] Renmin Univ China, Sch Informat Resource Management, Beijing 100872, Peoples R China
[2] Nanjing Inst Cognit IoT, Nanjing 210001, Peoples R China
关键词
Surface defect detection; Multiple instance learning; Convolutional neural network; MIL-Resnet50;
D O I
10.1016/j.eswa.2024.124244
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Artificial intelligence (AI)-empowered defect detection has emerged as a promising solution for enhancing quality control in manufacturing. While prevalent object detection-based methods have achieved competitive performance, they do carry inherent limitations that necessitate further refinement prior to their practical application in online surface defect detection. This study introduces an efficient online surface defect detection method that makes predictions on the presence of defects based on image-level labels. The method leverages the multiple instance learning (MIL) framework, and utilizes convolutional neural network (CNN) as feature extractor. Extensive experiments are conducted on two real-world datasets to evaluate the method with a custom CNN and Resnet50 as feature extractors (referred to as MIL-CNN and MIL-Resnet50). The results demonstrate the superiority of the proposed method compared with the well-established benchmark methods, especially highlighting the advantage of MIL-Resnet50. Without requiring fine-grained labeling, MIL-Resnet50 enhances F1macro by 2.5% and 1.5% within the two datasets compared to the second-ranking. Notably, it excels in detecting small-object defects. It also exhibits advantages in terms of detection speed, and are lightweight, making it easy to deploy even in resource-limited scenarios. Additionally, MIL-Resnet50 exhibits the capability to provide approximate defect localization through feature maps. These findings highlight the significant potential of the proposed method within industrial applications.
引用
收藏
页数:10
相关论文
共 42 条
  • [1] Lightweight and computationally faster Hypermetropic Convolutional Neural Network for small size object detection
    Amudhan, A. N.
    Sudheer, A. P.
    [J]. IMAGE AND VISION COMPUTING, 2022, 119
  • [2] A full data augmentation pipeline for small object detection based on generative adversarial networks
    Bosquet, Brais
    Cores, Daniel
    Seidenari, Lorenzo
    Brea, Victor M.
    Mucientes, Manuel
    Del Bimbo, Alberto
    [J]. PATTERN RECOGNITION, 2023, 133
  • [3] Clinical-grade computational pathology using weakly supervised deep learning on whole slide images
    Campanella, Gabriele
    Hanna, Matthew G.
    Geneslaw, Luke
    Miraflor, Allen
    Silva, Vitor Werneck Krauss
    Busam, Klaus J.
    Brogi, Edi
    Reuter, Victor E.
    Klimstra, David S.
    Fuchs, Thomas J.
    [J]. NATURE MEDICINE, 2019, 25 (08) : 1301 - +
  • [4] ERF-YOLO: A YOLO algorithm compatible with fewer parameters and higher accuracy
    Chai, Enhui
    Ta, Lin
    Ma, Zhanfei
    Zhi, Min
    [J]. IMAGE AND VISION COMPUTING, 2021, 116
  • [5] A Machine Vision Apparatus and Method for Can-End Inspection
    Chen, Tiejian
    Wang, Yaonan
    Xiao, Changyan
    Wu, Q. M. Jonathan
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2016, 65 (09) : 2055 - 2066
  • [6] Solving the multiple instance problem with axis-parallel rectangles
    Dietterich, TG
    Lathrop, RH
    LozanoPerez, T
    [J]. ARTIFICIAL INTELLIGENCE, 1997, 89 (1-2) : 31 - 71
  • [7] A Hierarchical Extractor-Based Visual Rail Surface Inspection System
    Gan, Jinrui
    Li, Qingyong
    Wang, Jianzhu
    Yu, Haomin
    [J]. IEEE SENSORS JOURNAL, 2017, 17 (23) : 7935 - 7944
  • [8] Discrepant multiple instance learning for weakly supervised object detection
    Gao, Wei
    Wan, Fang
    Yue, Jun
    Xu, Songcen
    Ye, Qixiang
    [J]. PATTERN RECOGNITION, 2022, 122
  • [9] A semi-supervised convolutional neural network-based method for steel surface defect recognition
    Gao Yiping
    Gao Liang
    Li Xinyu
    Yan Xuguo
    [J]. ROBOTICS AND COMPUTER-INTEGRATED MANUFACTURING, 2020, 61
  • [10] Fast R-CNN
    Girshick, Ross
    [J]. 2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, : 1440 - 1448