Two-Stream Network One-Class Classification Model for Defect Inspections

被引:2
作者
Lee, Seunghun [1 ]
Luo, Chenglong [1 ]
Lee, Sungkwan [2 ]
Jung, Hoeryong [1 ]
机构
[1] Konkuk Univ, Div Mech & Aerosp Engn, 120 Neungdong Ro, Seoul 05029, South Korea
[2] Sambo Technol, 90 Centum Jungang Ro, Busan 48059, South Korea
关键词
defect inspection; machine vision; one-class classification; two-stream network; FAULT-DETECTION;
D O I
10.3390/s23125768
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Defect inspection is important to ensure consistent quality and efficiency in industrial manufacturing. Recently, machine vision systems integrating artificial intelligence (AI)-based inspection algorithms have exhibited promising performance in various applications, but practically, they often suffer from data imbalance. This paper proposes a defect inspection method using a one-class classification (OCC) model to deal with imbalanced datasets. A two-stream network architecture consisting of global and local feature extractor networks is presented, which can alleviate the representation collapse problem of OCC. By combining an object-oriented invariant feature vector with a training-data-oriented local feature vector, the proposed two-stream network model prevents the decision boundary from collapsing to the training dataset and obtains an appropriate decision boundary. The performance of the proposed model is demonstrated in the practical application of automotive-airbag bracket-welding defect inspection. The effects of the classification layer and two-stream network architecture on the overall inspection accuracy were clarified by using image samples collected in a controlled laboratory environment and from a production site. The results are compared with those of a previous classification model, demonstrating that the proposed model can improve the accuracy, precision, and F1 score by up to 8.19%, 10.74%, and 4.02%, respectively.
引用
收藏
页数:15
相关论文
共 43 条
[1]  
Bendre Nihar, 2020, arXiv
[2]   A systematic study of the class imbalance problem in convolutional neural networks [J].
Buda, Mateusz ;
Maki, Atsuto ;
Mazurowski, Maciej A. .
NEURAL NETWORKS, 2018, 106 :249-259
[3]   Xception: Deep Learning with Depthwise Separable Convolutions [J].
Chollet, Francois .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :1800-1807
[4]  
Defard T, 2020, Arxiv, DOI arXiv:2011.08785
[5]   A Review on Recent Advances in Vision-based Defect Recognition towards Industrial Intelligence [J].
Gao, Yiping ;
Li, Xinyu ;
Wang, Xi Vincent ;
Wang, Lihui ;
Gao, Liang .
JOURNAL OF MANUFACTURING SYSTEMS, 2022, 62 :753-766
[6]  
Goyal S., 2020, P INT C MACH LEARN V
[7]  
Hasib K M., 2020, Journal of Computer Science, V16, P1546, DOI [DOI 10.3844/JCSSP.2020.1546.1557, 10.3844/jcssp.2020.1546.1557]
[8]   OCSTN: One-class time-series classification approach using a signal transformation network into a goal signal [J].
Hayashi, Toshitaka ;
Cimr, Dalibor ;
Studnicka, Filip ;
Fujita, Hamido ;
Busovsky, Damian ;
Cimler, Richard .
INFORMATION SCIENCES, 2022, 614 :71-86
[9]   One-class ensemble classifier for data imbalance problems [J].
Hayashi, Toshitaka ;
Fujita, Hamido .
APPLIED INTELLIGENCE, 2022, 52 (15) :17073-17089
[10]   Less complexity one-class classification approach using construction error of convolutional image transformation network [J].
Hayashi, Toshitaka ;
Fujita, Hamido ;
Hernandez-Matamoros, Andres .
INFORMATION SCIENCES, 2021, 560 :217-234