Automated Structure Matching of Printed Circuit Boards

被引:1
作者
Hirsch, Calvin [1 ]
Spielberg, Jeff [1 ]
机构
[1] Two Six Technol, Arlington, VA 22203 USA
来源
2022 IEEE PHYSICAL ASSURANCE AND INSPECTION OF ELECTRONICS (PAINE) | 2022年
关键词
printed circuit board; object detection; structure matching; similarity; computer vision; machine learning; deep learning;
D O I
10.1109/PAINE56030.2022.10014903
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
We address the challenge of matching photos of printed circuit boards (PCBs) that have the same layout. A simple approach to this problem is to use an off-the-shelf computer vision (CV) machine learning (ML) model to embed images into vectors and then calculate the similarity between those embeddings. However, this approach is prone to diversion by visual differences between photos that do not affect PCB layout. With a large, paired dataset of matching PCBs with visual differences, it would be possible to train a ML model to ignore these visual differences, but such a dataset does not exist and is expensive to create. We develop an approach that alleviates this problem by considering only component bounding boxes and classes, as outputted by an object detection ML model, forcing it to ignore irrelevant visual features. Specifically, we use a structure matching algorithm that compares the type, shape, and relative position of the components on the PCB. The algorithm uses the layout of the components as a proxy for the overall PCB layout. We demonstrate that our method can be used in conjunction with visual embedding similarity in order to take advantage of both visual similarities and structural similarities between PCB images. Our approach also has two unique capabilities. First, it finds the optimal alignment of the images such that matching components are overlaid. Second, in addition to photos, it can be directly applied to component data without the need for an object detector. This leaves the application of this algorithm open to manually inputted or modified component structures or schematics. We additionally open-source our evaluation and object detection code, model weights, and manually-gathered matched dataset used for evaluation at https://github.com/twosixlabs/pcb structure matching.
引用
收藏
页码:79 / 86
页数:8
相关论文
共 22 条
[1]  
Ballard Dana H., 1987, 1987 ASS ADVANCEMENT
[2]  
Bao Hangbo., 2021, INT C LEARNING REPRE
[3]   Emerging Properties in Self-Supervised Vision Transformers [J].
Caron, Mathilde ;
Touvron, Hugo ;
Misra, Ishan ;
Jegou, Herve ;
Mairal, Julien ;
Bojanowski, Piotr ;
Joulin, Armand .
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, :9630-9640
[4]  
Deng J, 2009, PROC CVPR IEEE, P248, DOI 10.1109/CVPRW.2009.5206848
[5]   Rich feature hierarchies for accurate object detection and semantic segmentation [J].
Girshick, Ross ;
Donahue, Jeff ;
Darrell, Trevor ;
Malik, Jitendra .
2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, :580-587
[6]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[7]  
Kuehlmann Andreas, 2022, HARDWARE BILL MAT ES
[8]   Data-Efficient Graph Embedding Learning for PCB Component Detection [J].
Kuo, Chia-Wen ;
Ashmore, Jacob D. ;
Huggins, David ;
Kira, Zsolt .
2019 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2019, :551-560
[9]   Microsoft COCO: Common Objects in Context [J].
Lin, Tsung-Yi ;
Maire, Michael ;
Belongie, Serge ;
Hays, James ;
Perona, Pietro ;
Ramanan, Deva ;
Dollar, Piotr ;
Zitnick, C. Lawrence .
COMPUTER VISION - ECCV 2014, PT V, 2014, 8693 :740-755
[10]   Visualizing and Understanding Deep Texture Representations [J].
Lin, Tsung-Yu ;
Maji, Subhransu .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :2791-2799