Deep-Learning-Based Defect Detection for Light Aircraft With Unmanned Aircraft Systems

被引:3
作者
Connolly, Luke [1 ,3 ]
Garland, James [2 ,3 ]
O'Gorman, Diarmuid [1 ,3 ]
Tobin, Edmond F. [1 ,3 ]
机构
[1] South East Technol Univ, Dept Aerosp & Mech Engn, Carlow Campus, Carlow R93 V960, Ireland
[2] South East Technol Univ, Dept Elect Engn & Commun, Carlow Campus, Carlow R93 V960, Ireland
[3] South East Technol Univ, Ctr Res & Enterprise Engn engCORE, Carlow Campus, Carlow R93 V960, Ireland
关键词
Aircraft; Training; Inspection; Visualization; Atmospheric modeling; Computational modeling; Maintenance engineering; Deep learning; object detection; defects; aircraft damage detection;
D O I
10.1109/ACCESS.2024.3412204
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Visual inspections of aircraft are a vital aspect of aircraft maintenance. They involve ground personnel walking around the aircraft, mounting scaffolding or ladders, and fully inspecting the aircraft. A visual inspection, however, requires a significant amount of time to perform and may be prone to human error. To address these challenges, a deep-learning-based defect-detection model is proposed, which has the potential to reduce inspection time significantly and enhance inspection reliability. This approach utilises an Unmanned Aircraft System (UAS) equipped with an onboard camera system to capture images for analysis. The proposed machine-learning (ML) model is trained using a deep-learning framework, specifically YOLOv8, on a diverse dataset comprising of both defective and non-defective images of the aircraft. The labelling process for novel classes is accelerated through utilising a low accuracy pre-trained model. Following model analysis, the operator inspects the defects reported in the images. To facilitate efficient identification, object detection techniques, such as bounding boxes, are employed. In this study, various hyperparameter combinations to optimise the model's performance are explored. Implementing this ML detection system would mitigate the risks associated with human error and improve inspection accuracy, providing a safer visual inspection process for ground personnel and a more efficient solution for aircraft visual inspections for preventative maintenance. Moreover, the utilisation of a UAS enables inspections of inaccessible or hazardous areas without compromising personnel safety. This research demonstrates the potential of deep learning for aircraft visual inspections. The defects analysed are damaged and missing rivets, filiform corrosion, and missing panels, while future research aims to expand the scope to include additional defects such as paint chipping, scratches, burns, and rust. The model's capability to discern the condition of rivets, panels, and filiform corrosion is evidenced by its achieved validation mean Average Precision (mAP) of 85 %.
引用
收藏
页码:83876 / 83886
页数:11
相关论文
共 21 条
[1]  
[Anonymous], 2022, Chin. J. Aeronaut., V35, P254
[2]   Albumentations: Fast and Flexible Image Augmentations [J].
Buslaev, Alexander ;
Iglovikov, Vladimir I. ;
Khvedchenya, Eugene ;
Parinov, Alex ;
Druzhinin, Mikhail ;
Kalinin, Alexandr A. .
INFORMATION, 2020, 11 (02)
[3]   Autonomous Structural Visual Inspection Using Region-Based Deep Learning for Detecting Multiple Damage Types [J].
Cha, Young-Jin ;
Choi, Wooram ;
Suh, Gahyun ;
Mahmoudkhani, Sadegh ;
Buyukozturk, Oral .
COMPUTER-AIDED CIVIL AND INFRASTRUCTURE ENGINEERING, 2018, 33 (09) :731-747
[4]  
Drury C., 2002, Good Practices in Visual Inspection
[5]   Autonomous damage recognition in visual inspection of laminated composite structures using deep learning [J].
Fotouhi, Sakineh ;
Pashmforoush, Farzad ;
Bodaghi, Mahdi ;
Fotouhi, Mohamad .
COMPOSITE STRUCTURES, 2021, 268
[6]   Fast R-CNN [J].
Girshick, Ross .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :1440-1448
[7]  
He K., 2015, CORR, Vabs/1502.01852, DOI [DOI 10.1109/CVPR.2016.90, 10.1109/CVPR.2016.90]
[8]  
Jocher A., 2023, ULTRALYTICS YOLOV8
[9]   ImageNet Classification with Deep Convolutional Neural Networks [J].
Krizhevsky, Alex ;
Sutskever, Ilya ;
Hinton, Geoffrey E. .
COMMUNICATIONS OF THE ACM, 2017, 60 (06) :84-90
[10]   YOLOv3-Lite: A Lightweight Crack Detection Network for Aircraft Structure Based on Depthwise Separable Convolutions [J].
Li, Yadan ;
Han, Zhenqi ;
Xu, Haoyu ;
Liu, Lizhuang ;
Li, Xiaoqiang ;
Zhang, Keke .
APPLIED SCIENCES-BASEL, 2019, 9 (18)