FC-YOLO: an aircraft skin defect detection algorithm based on multi-scale collaborative feature fusion

被引:6
作者
Zhang, Wei [1 ,2 ,3 ]
Liu, Jiyuan [1 ,2 ]
Yan, Zhiqi [1 ,2 ]
Zhao, Minghang [4 ,5 ]
Fu, Xuyun [4 ,5 ]
Zhu, Hengjia [1 ]
机构
[1] Civil Aviat Univ China, Coll Aeronaut Engn, Tianjin 300300, Peoples R China
[2] Civil Aviat Univ China, Aviat Ground Special Equipment Res Base Civil Avia, Tianjin 300300, Peoples R China
[3] Key Lab Smart Airport Theory & Syst, Tianjin 300300, Peoples R China
[4] Harbin Inst Technol, Sch Ocean Engn, Weihai 264209, Peoples R China
[5] Harbin Inst Technol, Weihai Key Lab Intelligent Operat & Maintenance, Weihai, Peoples R China
基金
中国国家自然科学基金;
关键词
aircraft skin; defect detection; YOLO; feature fusion; attention mechanism; INSPECTION;
D O I
10.1088/1361-6501/ad6bad
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Aircraft skin defects pose a threat to the safety and airworthiness of the aircraft. The front line of engineering has requirements of high precision and stable defect detection, which cannot be met by existing deep learning methods, due to conflicting information between multi-scale features. Herein, a Fine-Coordinated YOLO (FC-YOLO) algorithm is proposed to detect aircraft skin defects. Firstly, the ELAN-C module with Coordinate & Channel Attention mechanism is applied to the backbone network to enhance multi-scale detection precision. Secondly, the Adaptive-Path Aggregation Network structure is proposed to make features containing more information by adding a shortcut weighted by the Adaptively Spatial Feature Fusion (ASFF) module. The ASFF adaptively allocates the weights of features with different sizes to reduce the inconsistency of features between different levels during feature fusion to improve detection precision. Finally, the SCYLLA-IoU loss function is introduced to calculate the directional loss between the bounding box and the ground truth box to elevate the stability of the training. Experiments are executed with a self-constructed ASD-DET dataset and the public NEU-DET dataset. Results show that the mAP of FC-YOLO is improved by 3.1% and 2.7% compared to that of the original YOLOv7 on the ASD-DET dataset and the NEU-DET dataset. In addition, on the ASD-DET dataset and NEU-DET dataset, the mAP of FC-YOLO was higher than that of YOLOv8, RT-DETR by 1.4%, 1.6% and 2.2%, 3.8%, respectively. By which, it is shown that the proposed FC-YOLO algorithm is promising for the future automatic visual inspection of aircraft skin.
引用
收藏
页数:21
相关论文
共 60 条
[1]  
Bochkovskiy A, 2020, Arxiv, DOI [arXiv:2004.10934, 10.48550/arXiv.2004.10934]
[2]   Design and Fabrication of a Passive 1D Morphing Aircraft Skin [J].
Bubert, Edward A. ;
Woods, Benjamin K. S. ;
Lee, Keejoo ;
Kothera, Curt S. ;
Wereley, N. M. .
JOURNAL OF INTELLIGENT MATERIAL SYSTEMS AND STRUCTURES, 2010, 21 (17) :1699-1717
[3]   Disentangle Your Dense Object Detector [J].
Chen, Zehui ;
Yang, Chenhongyi ;
Li, Qiaofei ;
Zhao, Feng ;
Zha, Zheng-Jun ;
Wu, Feng .
PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, :4939-4948
[4]   Visual inspection of aircraft skin: Automated pixel-level defect detection by instance segmentation [J].
Ding, Meng ;
Wu, Boer ;
Xu, Juan ;
Kasule, Abdul Nasser ;
Zuo, Hongfu .
CHINESE JOURNAL OF AERONAUTICS, 2022, 35 (10) :254-264
[5]   RepVGG: Making VGG-style ConvNets Great Again [J].
Ding, Xiaohan ;
Zhang, Xiangyu ;
Ma, Ningning ;
Han, Jungong ;
Ding, Guiguang ;
Sun, Jian .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :13728-13737
[6]  
Dosovitskiy A, 2021, Arxiv, DOI [arXiv:2010.11929, 10.48550/arXiv.2010.11929, DOI 10.48550/ARXIV.2010.11929]
[7]   Equivalent initial flaw size testing and analysis of transport aircraft skin splices [J].
Fawaz, SA .
FATIGUE & FRACTURE OF ENGINEERING MATERIALS & STRUCTURES, 2003, 26 (03) :279-290
[8]   Dual Attention Network for Scene Segmentation [J].
Fu, Jun ;
Liu, Jing ;
Tian, Haijie ;
Li, Yong ;
Bao, Yongjun ;
Fang, Zhiwei ;
Lu, Hanqing .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :3141-3149
[9]  
Gevorgyan Z, 2022, Arxiv, DOI [arXiv:2205.12740, 10.48550/arXiv.2205.12740, DOI 10.48550/ARXIV.2205.12740]
[10]   Investigation of carbon fiber reinforced polymer (CFRP) sheet with subsurface defects inspection using thermal-wave radar imaging (TWRI) based on the multi-transform technique [J].
Gong, Jinlong ;
Liu, Junyan ;
Qin, Lei ;
Wang, Yang .
NDT & E INTERNATIONAL, 2014, 62 :130-136