Real-Time On-Board Deep Learning Fault Detection for Autonomous UAV Inspections

被引:36
作者
Ayoub, Naeem [1 ]
Schneider-Kamp, Peter [1 ]
机构
[1] Univ Southern Denmark, Dept Math & Comp Sci, DK-5230 Odense M, Denmark
关键词
unmanned aerial vehicles; edge computing; deep learning; object recognition; fault detection;
D O I
10.3390/electronics10091091
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Inspection of high-voltage power lines using unmanned aerial vehicles is an emerging technological alternative to traditional methods. In the Drones4Energy project, we work toward building an autonomous vision-based beyond-visual-line-of-sight (BVLOS) power line inspection system. In this paper, we present a deep learning-based autonomous vision system to detect faults in power line components. We trained a YOLOv4-tiny architecture-based deep neural network, as it showed prominent results for detecting components with high accuracy. For running such deep learning models in a real-time environment, different single-board devices such as the Raspberry Pi 4, Nvidia Jetson Nano, Nvidia Jetson TX2, and Nvidia Jetson AGX Xavier were used for the experimental evaluation. Our experimental results demonstrated that the proposed approach can be effective and efficient for fully automatic real-time on-board visual power line inspection.
引用
收藏
页数:14
相关论文
共 20 条
[1]   Survey of computer vision algorithms and applications for unmanned aerial vehicles [J].
Al-Kaff, Abdulla ;
Martin, David ;
Garcia, Fernando ;
de la Escalera, Arturo ;
Maria Armingol, Jose .
EXPERT SYSTEMS WITH APPLICATIONS, 2018, 92 :447-463
[2]   Vision-Based Novelty Detection Using Deep Features and Evolved Novelty Filters for Specific Robotic Exploration and Inspection Tasks [J].
Antonio Contreras-Cruz, Marco ;
Pablo Ramirez-Paredes, Juan ;
Haile Hernandez-Belmonte, Uriel ;
Ayala-Ramirez, Victor .
SENSORS, 2019, 19 (13)
[3]   Real-time On-board Detection of Components and Faults in an Autonomous UAV System for Power Line Inspection [J].
Ayoub, Naeem ;
Schneider-Kamp, Peter .
PROCEEDINGS OF THE 1ST INTERNATIONAL CONFERENCE ON DEEP LEARNING THEORY AND APPLICATIONS (DELTA), 2020, :68-75
[4]  
Bochkovskiy A., 2020, arXiv pre-print server, DOI DOI 10.48550/ARXIV.2004.10934
[5]   Cable-crawler - robot for the inspection of high-voltage power lines that can passively roll over mast tops [J].
Buehringer, Maleachi ;
Berchtold, Jan ;
Buechel, Melanie ;
Dold, Claus ;
Buetikofer, Michael ;
Feuerstein, Mevina ;
Fischer, Wolfgang ;
Bermes, Christian ;
Siegwart, Roland .
INDUSTRIAL ROBOT-THE INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH AND APPLICATION, 2010, 37 (03) :256-262
[6]  
Dai J, 2016, PROCEEDINGS 2016 IEEE INTERNATIONAL CONFERENCE ON INDUSTRIAL TECHNOLOGY (ICIT), P1796, DOI 10.1109/ICIT.2016.7475036
[7]   Rich feature hierarchies for accurate object detection and semantic segmentation [J].
Girshick, Ross ;
Donahue, Jeff ;
Darrell, Trevor ;
Malik, Jitendra .
2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, :580-587
[8]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[9]  
Li Yandong, 2016, Journal of Computer Applications, V36, P2508, DOI 10.11772/j.issn.1001-9081.2016.09.2508
[10]   SSD: Single Shot MultiBox Detector [J].
Liu, Wei ;
Anguelov, Dragomir ;
Erhan, Dumitru ;
Szegedy, Christian ;
Reed, Scott ;
Fu, Cheng-Yang ;
Berg, Alexander C. .
COMPUTER VISION - ECCV 2016, PT I, 2016, 9905 :21-37