Real-time On-board Detection of Components and Faults in an Autonomous UAV System for Power Line Inspection

被引:10
作者
Ayoub, Naeem [1 ]
Schneider-Kamp, Peter [1 ]
机构
[1] Univ Southern Denmark, Dept Math & Comp Sci, Odense, Denmark
来源
PROCEEDINGS OF THE 1ST INTERNATIONAL CONFERENCE ON DEEP LEARNING THEORY AND APPLICATIONS (DELTA) | 2020年
关键词
Power Lines Inspection; Fault Detection; Autonomous Drones Systems; Deep Learning;
D O I
10.5220/0009826700680075
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The inspection of power line components is periodically conducted by specialized companies to identify possible faults and assess the state of the critical infrastructure. UAV-systems represent an emerging technological alternative in this field, with the promise of safer, more efficient, and less costly inspections. In the Drones4Energy project, we work toward a vision-based beyond-visual-line-of-sight (BVLOS) power line inspection architecture for automatically and autonomously detecting components and faults in real-time on board of the UAV. In this paper, we present the first step towards the vision system of this architecture. We train Deep Neural Networks (DNNs) and tune them for reliability under different conditions such as variations in camera used, lighting, angles, and background. For the purpose of real-time on-board implementation of the architecture, experimental evaluations and comparisons are performed on different hardware such as Raspberry Pi 4, Nvidia Jetson Nano, Nvidia Jetson TX2, and Nvidia Jetson AGX Xavier. The use of such Single Board Devices (SBDs) is an integral part of the design of the proposed power line inspection architecture. Our experimental results demonstrate that the proposed approach can be effective and efficient for fully-automatic real-time on-board visual power line inspection.
引用
收藏
页码:68 / 75
页数:8
相关论文
共 23 条
[1]   A survey of automation-enabled human-in-the-loop systems for infrastructure visual inspection [J].
Agnisarman, Sruthy ;
Lopes, Snowil ;
Madathil, Kapil Chalil ;
Piratla, Kalyan ;
Gramopadhye, Anand .
AUTOMATION IN CONSTRUCTION, 2019, 97 :52-76
[2]   Survey of computer vision algorithms and applications for unmanned aerial vehicles [J].
Al-Kaff, Abdulla ;
Martin, David ;
Garcia, Fernando ;
de la Escalera, Arturo ;
Maria Armingol, Jose .
EXPERT SYSTEMS WITH APPLICATIONS, 2018, 92 :447-463
[3]   Power transmission line inspection robots: A review, trends and challenges for future research [J].
Alhassan, Ahmad Bala ;
Zhang, Xiaodong ;
Shen, Haiming ;
Xu, Haibo .
INTERNATIONAL JOURNAL OF ELECTRICAL POWER & ENERGY SYSTEMS, 2020, 118
[4]   Vision-Based Novelty Detection Using Deep Features and Evolved Novelty Filters for Specific Robotic Exploration and Inspection Tasks [J].
Antonio Contreras-Cruz, Marco ;
Pablo Ramirez-Paredes, Juan ;
Haile Hernandez-Belmonte, Uriel ;
Ayala-Ramirez, Victor .
SENSORS, 2019, 19 (13)
[5]   LiDAR-Based Real-Time Detection and Modeling of Power Lines for Unmanned Aerial Vehicles [J].
Azevedo, Fabio ;
Dias, Andre ;
Almeida, Jose ;
Oliveira, Alexandre ;
Ferreira, Andre ;
Santos, Tiago ;
Martins, Alfredo ;
Silva, Eduardo .
SENSORS, 2019, 19 (08)
[6]  
Buhringer M., 2010, Ind. Robot. Int. J.
[7]  
Dai JF, 2016, ADV NEUR IN, V29
[8]  
Gao Z., 2019, J SENSORS, V2019
[9]   Rich feature hierarchies for accurate object detection and semantic segmentation [J].
Girshick, Ross ;
Donahue, Jeff ;
Darrell, Trevor ;
Malik, Jitendra .
2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, :580-587
[10]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778