An active learning method based on result quality evaluation for printed circuit board computed tomography image segmentation

被引:0
作者
Song, Baojie [1 ]
Qiao, Kai [1 ]
Yang, Jie [1 ]
Shi, Shuhao [1 ]
Chen, Jian [1 ]
Yan, Bin [1 ]
机构
[1] Peoples Liberat Army PLA Strateg Support Force Inf, Henan Key Lab Imaging & Intelligent Proc, Zhengzhou 450001, Henan, Peoples R China
关键词
computer vision; image segmentation; inverse problems; non-destructive testing;
D O I
10.1049/ipr2.12888
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Element detection is a key step in non-destructive testing of printed circuit board (PCB) based on computed tomography (CT). In recent years, some image segmentation methods based on deep learning have shown great potential in the element segmentation task of PCB CT images, and greatly improved the efficiency and accuracy. However, since image segmentation is based on pixel-level classification, the annotation of training data is difficult and costly. Aiming at this problem, the authors proposed a new active learning method based on the integration of relevant information about segmentation tasks and data variance. In this method, the Result Quality Evaluation Module (RQEM) proposed by us is used to generate task-related information, and an adversarial network is used to generate the difference information between samples and the initial labelled data. Finally, the two parts of information are fused and used as the standard of data selecting. In the PCB CT image element segmentation task, the authors only need to select 12.7% of the whole training set with their proposed method to make Mean Intersection Over Union (MIOU) reach 79.7, which has reached 95% of the optimal performance of 83.7. The in-depth analysis also verifies the effectiveness and stability of the authors' method.
引用
收藏
页码:3688 / 3701
页数:14
相关论文
共 51 条
[11]  
Citovsky G., 2021, Proc. Adv. Neural Inf. Process. Syst., V34, P11933
[12]   Automated inspection of PCB components using a genetic algorithm template-matching approach [J].
Crispin, A. J. ;
Rankov, V. .
INTERNATIONAL JOURNAL OF ADVANCED MANUFACTURING TECHNOLOGY, 2007, 35 (3-4) :293-300
[13]  
Dosovitskiy A., 2020, ICLR, V20, DOI 10.48550/arXiv.2010.11929
[14]   Dual Attention Network for Scene Segmentation [J].
Fu, Jun ;
Liu, Jing ;
Tian, Haijie ;
Li, Yong ;
Bao, Yongjun ;
Fang, Zhiwei ;
Lu, Hanqing .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :3141-3149
[15]   Semi-supervised Active Learning for Semi-supervised Models: Exploit Adversarial Examples with Graph-based Virtual Labels [J].
Guo, Jiannan ;
Shi, Haochen ;
Kang, Yangyang ;
Kuang, Kun ;
Tang, Siliang ;
Jiang, Zhuoren ;
Sun, Changlong ;
Wu, Fei ;
Zhuang, Yueting .
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, :2876-2885
[16]  
Hacohen Guy, 2022, Active learning on a budget: Opposite strategies suit high and low budgets
[17]  
Herchenbach D, 2013, IEEE INTL CONF IND I, P59, DOI 10.1109/INDIN.2013.6622858
[18]   CCNet: Criss-Cross Attention for Semantic Segmentation [J].
Huang, Zilong ;
Wang, Xinggang ;
Huang, Lichao ;
Huang, Chang ;
Wei, Yunchao ;
Liu, Wenyu .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :603-612
[19]  
Jain Jitesh., 2021, Semask: Semantically masking transformer backbones for effective semantic segmentation. arXiv
[20]   Active Image Segmentation Propagation [J].
Jain, Suyog Dutt ;
Grauman, Kristen .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :2864-2873