Cascaded detection method for surface defects of lead frame based on high-resolution detection images

被引:14
作者
Sun, Tingrui [1 ]
Li, Zhiwei [1 ,2 ]
Xiao, Xinjie [1 ]
Guo, Zhihui [1 ]
Ning, Wenle [1 ]
Ding, Tingting [1 ]
机构
[1] Shanghai Univ Engn Sci, Coll Elect & Elect Engn, Shanghai 201620, Peoples R China
[2] Shanghai Technol & Innovat Vocat Coll, Shanghai 201620, Peoples R China
基金
中国国家自然科学基金;
关键词
Lead frame; Surface defect detection; Deep learning; High-resolution image; Machine vision; INSPECTION SYSTEM;
D O I
10.1016/j.jmsy.2023.11.017
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
In the field of semiconductor production and manufacturing, the detection of defects on lead frame surfaces is a vital process. This process plays a key role in ensuring the quality of the final product. Using high-resolution detection images to detect multi-scale tiny surface defects is necessary, but this amplifies the impact of environmental noise. Therefore, suppressing both the false negative rate and false positive rate in practical detection scenarios is a challenge that needs to be overcome. Current research on lead frame surface defect detection is mostly concentrated on the downloaded standard original images, which limits its application in actual production lines. This paper presents a cascaded detection method for surface defects of lead frame based on high-resolution detection images. Firstly, this study presents the unit cell extraction module to convert the detection object from high-resolution image to hundreds of unit cells. The proposed module can handle real-time detection images in the production pipeline, especially addressing situations such as lighting imbalances and tilted detection images. Subsequently, this study proposes a lead frame surface defect detection network (LDD-net), which takes unit cells as inputs and can effectively detect multi-scale defects. Compared to other models, LDD-net can effectively capture the features of subtle defects. Additionally, this paper introduces the deviation in the central width direction into the CIoU localization loss, enhancing the accuracy of defect localization in LDD-net. The data set is constructed using the machine vision detection system and conducts training and testing. Specifically, experiments of LDD-net on the data set obtained 85.01% mean average precision (mAP) and 37 ms of inference time, respectively. The detection accuracy exceeds 95%, and the false negative rate can be controlled below 6%. This approach will assist manual monitoring personnel in evaluating product quality.
引用
收藏
页码:180 / 195
页数:16
相关论文
共 45 条
[1]   VIBE: A POWERFUL RANDOM TECHNIQUE TO ESTIMATE THE BACKGROUND IN VIDEO SEQUENCES [J].
Barnich, Olivier ;
Van Droogenbroeck, Marc .
2009 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, VOLS 1- 8, PROCEEDINGS, 2009, :945-948
[2]   Automatic detection of stamping defects in leadframes using machine vision: Overcoming translational and rotational misalignment [J].
Bhuvanesh, Abhinesh ;
Ratnam, Mani Maran .
INTERNATIONAL JOURNAL OF ADVANCED MANUFACTURING TECHNOLOGY, 2007, 32 (11-12) :1201-1210
[3]  
Bochkovskiy A, 2020, Arxiv, DOI [arXiv:2004.10934, 10.48550/arXiv.2004.10934, DOI 10.48550/ARXIV.2004.10934]
[4]   Soft-NMS - Improving Object Detection With One Line of Code [J].
Bodla, Navaneeth ;
Singh, Bharat ;
Chellappa, Rama ;
Davis, Larry S. .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :5562-5570
[5]   End-to-End Object Detection with Transformers [J].
Carion, Nicolas ;
Massa, Francisco ;
Synnaeve, Gabriel ;
Usunier, Nicolas ;
Kirillov, Alexander ;
Zagoruyko, Sergey .
COMPUTER VISION - ECCV 2020, PT I, 2020, 12346 :213-229
[6]   Automatic optical inspection system for IC molding surface [J].
Chen, Ssu-Han ;
Perng, Der-Baau .
JOURNAL OF INTELLIGENT MANUFACTURING, 2016, 27 (05) :915-926
[7]   Surface Defect Detection Methods for Industrial Products: A Review [J].
Chen, Yajun ;
Ding, Yuanyuan ;
Zhao, Fan ;
Zhang, Erhu ;
Wu, Zhangnan ;
Shao, Linhao .
APPLIED SCIENCES-BASEL, 2021, 11 (16)
[8]   An automated CAD system for progressive working of irregular shaped metal products and lead frame for semiconductors [J].
Choi, JC ;
Kim, C ;
Yoon, JH .
INTERNATIONAL JOURNAL OF ADVANCED MANUFACTURING TECHNOLOGY, 2000, 16 (09) :624-634
[9]  
Dainis G. A. III, 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.88CH2605-4), P580, DOI 10.1109/CVPR.1988.196294
[10]   Developing a surface mount technology defect detection system for mounted devices on printed circuit boards using a MobileNetV2 with Feature Pyramid Network [J].
Diamini, Sifundvolesihle ;
Kuo, Chung-Feng Jeffrey ;
Chao, Shin-Min .
ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 121