CS-ResNet: Cost-sensitive residual convolutional neural network for PCB cosmetic defect detection

被引:109
作者
Zhang, Huan [1 ]
Jiang, Liangxiao [1 ,2 ]
Li, Chaoqun [3 ]
机构
[1] China Univ Geosci, Sch Comp Sci, Wuhan 430074, Peoples R China
[2] Minist Educ, Key Lab Artificial Intelligence, Shanghai 200240, Peoples R China
[3] China Univ Geosci, Sch Math & Phys, Wuhan 430074, Peoples R China
基金
中国国家自然科学基金;
关键词
PCB cosmetic defect detection; Residual convolutional neural network; Class imbalance; Cost-sensitive learning;
D O I
10.1016/j.eswa.2021.115673
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In the printed circuit board (PCB) industry, cosmetic defect detection is an essential process to ensure product quality. However, existing PCB cosmetic defect detection approaches have a high false alarm rate, which lead to expensive labor costs of manual confirmation. To solve this problem, some traditional machine learning-based approaches have been proposed, but they just utilize hand-crafted features to build classifiers and thus are rough and sub-optimal. Recently, due to its powerful capability in automatic feature extraction, convolutional neural network (CNN) has been widely used in PCB cosmetic defect detection. However, few of them pay attention to the imbalanced class distribution as well as the different misclassification costs of real and pseudo defects, both of which are common problems in the PCB industry. To this end, in this study, we propose a novel model called cost-sensitive residual convolutional neural network (CS-ResNet) by adding a cost-sensitive adjustment layer in the standard ResNet. Specifically, we assign larger weights to minority real defects based on the class-imbalance degree and then optimize CS-ResNet by minimizing the weighted cross-entropy loss function. We conducted a series of experiments by comparing CS-ResNet with the standard ResNet, state-of-theart CNN-based approach Auto-VRS and traditional machine learning-based approach HOG-SVM on a real-world PCB cosmetic defect dataset. Experimental results show that CS-ResNet achieves the highest Sensitivity (0.89), G -mean (0.91) and the lowest misclassification costs.
引用
收藏
页数:10
相关论文
共 42 条
  • [11] Cost-sensitive learning classification strategy for predicting product failures
    Frumosu, Flavia Dalia
    Khan, Abdul Rauf
    Schioler, Henrik
    Kulahci, Murat
    Zaki, Mohamed
    Westermann-Rasmussen, Peter
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2020, 161
  • [12] An efficient similarity measure approach for PCB surface defect detection
    Gaidhane, Vilas H.
    Hote, Yogesh V.
    Singh, Vijander
    [J]. PATTERN ANALYSIS AND APPLICATIONS, 2018, 21 (01) : 277 - 289
  • [13] Learning from class-imbalanced data: Review of methods and applications
    Guo Haixiang
    Li Yijing
    Shang, Jennifer
    Gu Mingyun
    Huang Yuanyue
    Bing, Gong
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2017, 73 : 220 - 239
  • [14] Text mining approach for bottleneck detection and analysis in printed circuit board manufacturing
    Hao, Po-Chien
    Lin, Bertrand M. T.
    [J]. COMPUTERS & INDUSTRIAL ENGINEERING, 2021, 154
  • [15] A real-time approach for automatic defect detection from PCBs based on SURF features and morphological operations
    Hassanin, Abdel-Aziz I. M.
    Abd El-Samie, Fathi E.
    El Banby, Ghada M.
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2019, 78 (24) : 34437 - 34457
  • [16] Deep Residual Learning for Image Recognition
    He, Kaiming
    Zhang, Xiangyu
    Ren, Shaoqing
    Sun, Jian
    [J]. 2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 770 - 778
  • [17] Ioffe S, 2015, PR MACH LEARN RES, V37, P448
  • [18] Deep normalized convolutional neural network for imbalanced fault classification of machinery and its understanding via visualization
    Jia, Feng
    Lei, Yaguo
    Lu, Na
    Xing, Saibo
    [J]. MECHANICAL SYSTEMS AND SIGNAL PROCESSING, 2018, 110 : 349 - 367
  • [19] Automatic diagnosis of imbalanced ophthalmic images using a cost-sensitive deep convolutional neural network
    Jiang, Jiewei
    Liu, Xiyang
    Zhang, Kai
    Long, Erping
    Wang, Liming
    Li, Wangting
    Liu, Lin
    Wang, Shuai
    Zhu, Mingmin
    Cui, Jiangtao
    Liu, Zhenzhen
    Lin, Zhuoling
    Li, Xiaoyan
    Chen, Jingjing
    Cao, Qianzhong
    Li, Jing
    Wu, Xiaohang
    Wang, Dongni
    Wang, Jinghui
    Lin, Haotian
    [J]. BIOMEDICAL ENGINEERING ONLINE, 2017, 16
  • [20] Wrapper Framework for Test-Cost-Sensitive Feature Selection
    Jiang, Liangxiao
    Kong, Ganggang
    Li, Chaoqun
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2021, 51 (03): : 1747 - 1756