Surface defect detection of smartphone glass based on deep learning

被引:7
作者
Mao, Yuechu [1 ,2 ]
Yuan, Julong [1 ,2 ]
Zhu, Yongjian [3 ,4 ]
Jiang, Yingguang [1 ,2 ]
机构
[1] Zhejiang Univ Technol, Coll Mech Engn, Hangzhou 310023, Peoples R China
[2] Zhejiang Univ Technol, Ultraprecis Machining Ctr, Key Lab Special Purpose Equipment & Adv Proc Techn, Minist Educ & Zhejiang Prov, Hangzhou, Peoples R China
[3] Shanghai Inst Technol, Coll Comp Sci & Informat Engn, Shanghai 200000, Peoples R China
[4] Ningbo Minjie Informat Technol Co, Ningbo 315000, Peoples R China
关键词
Deep learning; YOLO; Smartphone glass; Defect inspection; Defect detection; Computer vision; INSPECTION;
D O I
10.1007/s00170-023-11443-9
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Because of the high difficulty of smartphone glass detection and the variety of defect morphologies, the detection results are easily affected by the environment, making it difficult to meet the accuracy requirements of industrial inspection. Based on the existing YOLO v5s network, this study proposes a new network Dy-YOLO v5s. In particular, an attention module is introduced into the residual structure, and the cross-scale and cross-layer connections of feature maps are added to the Neck to improve the feature extraction and information exchange capabilities of the detection network. This algorithm introduces the dynamic detection framework called dynamic head (DyHead), which improves the detection head's capacity for perception. Additionally, the redundant anchor boxes and the balance of positive and negative samples are deduplicated using the confidence propagation cluster (cp-cluster) and varifocal loss functions. The experimental results demonstrate that when the intersection over union (IOU) threshold is set to 50%, the mean average precision (mAP) of Dy-YOLO v5s, precision rate (P), and recall rate (R) reach values of 96.2%, 92.6%, and 93.1%, respectively. Compared with YOLO v5s, mAP@0.5 and mAP@0.5-0.95 increased by 4.5% and 4.6%, respectively. The approach also has significant advantages over other deep-learning algorithms in terms of overall accuracy and real-time performance. Therefore, it can fully satisfy the detection requirements of smartphone glass.
引用
收藏
页码:5817 / 5829
页数:13
相关论文
共 30 条
[21]   MobileNetV2: Inverted Residuals and Linear Bottlenecks [J].
Sandler, Mark ;
Howard, Andrew ;
Zhu, Menglong ;
Zhmoginov, Andrey ;
Chen, Liang-Chieh .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :4510-4520
[22]   Confidence Propagation Cluster: Unleash Full Potential of Object Detectors [J].
Shen, Yichun ;
Jiang, Wanli ;
Xu, Zhen ;
Li, Rundong ;
Kwon, Junghyun ;
Li, Siyi .
2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, :1141-1151
[23]   Defect inspection of wafers by laser scattering [J].
Takami, K .
MATERIALS SCIENCE AND ENGINEERING B-SOLID STATE MATERIALS FOR ADVANCED TECHNOLOGY, 1997, 44 (1-3) :181-187
[24]   YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors [J].
Wang, Chien-Yao ;
Bochkovskiy, Alexey ;
Liao, Hong-Yuan Mark .
2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, :7464-7475
[25]   Scaled-YOLOv4: Scaling Cross Stage Partial Network [J].
Wang, Chien-Yao ;
Bochkovskiy, Alexey ;
Liao, Hong-Yuan Mark .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :13024-13033
[26]  
Wang CY, 2020, GLASS, V47, P1
[27]   Vision-Based Defect Detection for Mobile Phone Cover Glass using Deep Neural Networks [J].
Yuan, Zhi-Chao ;
Zhang, Zheng-Tao ;
Su, Hu ;
Zhang, Lei ;
Shen, Fei ;
Zhang, Feng .
INTERNATIONAL JOURNAL OF PRECISION ENGINEERING AND MANUFACTURING, 2018, 19 (06) :801-810
[28]   VarifocalNet: An IoU-aware Dense Object Detector [J].
Zhang, Haoyang ;
Wang, Ying ;
Dayoub, Feras ;
Sunderhauf, Niko .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :8510-8519
[29]   EPSANet: An Efficient Pyramid Squeeze Attention Block on Convolutional Neural Network [J].
Zhang, Hu ;
Zu, Keke ;
Lu, Jian ;
Zou, Yuru ;
Meng, Deyu .
COMPUTER VISION - ACCV 2022, PT III, 2023, 13843 :541-557
[30]   Deformable ConvNets v2: More Deformable, Better Results [J].
Zhu, Xizhou ;
Hu, Han ;
Lin, Stephen ;
Dai, Jifeng .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :9300-9308