A light weight multi-scale feature fusion steel surface defect detection model based on YOLOv8

被引:40
作者
Xie, Weining [1 ]
Sun, Xiaoyong [1 ]
Ma, Weifeng [1 ]
机构
[1] Zhejiang Univ Sci & Technol, Sch Informat & Elect Engn, 318 Liuhe Rd, Hangzhou 310023, Zhejiang, Peoples R China
关键词
defect detection; YOLOv8; deep learning; feature fusion;
D O I
10.1088/1361-6501/ad296d
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
In industrial production, the steel surface may incur different defects owing to the influence of external factors, thereby affecting the performance of steel. With the increasing requirements for steel quality, achieving efficient detection of steel surface defects is a difficult problem that urgently needs to be solved. Traditional steel surface defect detection methods are limited by poor detection performance and slow detection speed. Therefore, a model named LMS-YOLO, based on YOLOv8, is proposed in this paper for achieving efficient steel surface defect detection. Firstly, in backbone, the light weight multi-scale mixed convolution (LMSMC) module is designed to fuse with C2f to obtain C2f_LMSMC, so as to extract the features of different scales for fusion and achieve the light weight of the network. Meanwhile, the proposed efficient global attention mechanism was added to backbone to enhance cross dimensional information interaction and feature extraction capabilities, and to achieve a more efficient attention mechanism. In neck, using channel tuning to achieve better cross scale fusion in BiFPN. Finally, the model uses three independent decoupled heads for regression and classification, and replaces CIoU with NWD as the regression loss to enhance the effect of detecting small scale defects. The experimental results showed that LMS-YOLO achieved 81.1 mAP and 61.3 FPS on NEU-DET, 80.5 mAP and 61.3 FPS on GC10-DET, respectively. The mAP increased by 2.8 and 4.7 compared to YOLOv8, and decreased by 17.4% in floating point operations (GFLOPs) and 34.2% in parameters (Params), which indicates that the model proposed in this paper has a better comprehensive performance compared with other methods in steel surface defect detection.
引用
收藏
页数:17
相关论文
共 60 条
[1]  
Aboah A., 2023, P IEEECVF C COMPUTER, P5349
[2]   Sub-surface defect detection in a steel sheet [J].
Atzlesberger, J. ;
Zagar, B. G. ;
Cihal, R. ;
Brummayer, M. ;
Reisinger, P. .
MEASUREMENT SCIENCE AND TECHNOLOGY, 2013, 24 (08)
[3]  
Bochkovskiy A, 2020, Arxiv, DOI arXiv:2004.10934
[4]   End-to-End Object Detection with Transformers [J].
Carion, Nicolas ;
Massa, Francisco ;
Synnaeve, Gabriel ;
Usunier, Nicolas ;
Kirillov, Alexander ;
Zagoruyko, Sergey .
COMPUTER VISION - ECCV 2020, PT I, 2020, 12346 :213-229
[5]   Autonomous Structural Visual Inspection Using Region-Based Deep Learning for Detecting Multiple Damage Types [J].
Cha, Young-Jin ;
Choi, Wooram ;
Suh, Gahyun ;
Mahmoudkhani, Sadegh ;
Buyukozturk, Oral .
COMPUTER-AIDED CIVIL AND INFRASTRUCTURE ENGINEERING, 2018, 33 (09) :731-747
[6]   ESDDNet: efficient small defect detection network of workpiece surface [J].
Chen, Guodong ;
Xu, Feng ;
Liu, Guihua ;
Chen, ChunMei ;
Liu, Manlu ;
Zhang, Jing ;
Niu, Xiaoming .
MEASUREMENT SCIENCE AND TECHNOLOGY, 2022, 33 (10)
[7]   A real-time surface inspection system for precision steel balls based on machine vision [J].
Chen, Yi-Ji ;
Tsai, Jhy-Cherng ;
Hsu, Ya-Chen .
MEASUREMENT SCIENCE AND TECHNOLOGY, 2016, 27 (07)
[8]   RetinaNet With Difference Channel Attention and Adaptively Spatial Feature Fusion for Steel Surface Defect Detection [J].
Cheng, Xun ;
Yu, Jianbo .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2021, 70 (70)
[9]   Classification of steel balls by resonant eddy-current sensor [J].
Dao, Duy-Vinh ;
Jeng, Jen-Tzong ;
Doan, Van-Dong ;
Dinh, Chinh-Hieu ;
Pham, Thi-Trang ;
Nguyen, Huu-Thang .
MEASUREMENT SCIENCE AND TECHNOLOGY, 2022, 33 (02)
[10]   TOOD: Task-aligned One-stage Object Detection [J].
Feng, Chengjian ;
Zhong, Yujie ;
Gao, Yu ;
Scott, Matthew R. ;
Huang, Weilin .
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, :3490-3499