Learning-Based Autonomous UAV System for Electrical and Mechanical (E&M) Device Inspection

被引:15
作者
Feng, Yurong [1 ]
Tse, Kwaiwa [1 ]
Chen, Shengyang [1 ]
Wen, Chih-Yung [1 ,2 ]
Li, Boyang [2 ]
机构
[1] Hong Kong Polytech Univ, Dept Mech Engn, Kowloon, Hong Kong 999077, Peoples R China
[2] Hong Kong Polytech Univ, Interdisciplinary Div Aeronaut & Aviat Engn, Kowloon, Hong Kong 999077, Peoples R China
关键词
UAV; autonomous inspection; object detection; deep learning; VEHICLE;
D O I
10.3390/s21041385
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
The inspection of electrical and mechanical (E&M) devices using unmanned aerial vehicles (UAVs) has become an increasingly popular choice in the last decade due to their flexibility and mobility. UAVs have the potential to reduce human involvement in visual inspection tasks, which could increase efficiency and reduce risks. This paper presents a UAV system for autonomously performing E&M device inspection. The proposed system relies on learning-based detection for perception, multi-sensor fusion for localization, and path planning for fully autonomous inspection. The perception method utilizes semantic and spatial information generated by a 2-D object detector. The information is then fused with depth measurements for object state estimation. No prior knowledge about the location and category of the target device is needed. The system design is validated by flight experiments using a quadrotor platform. The result shows that the proposed UAV system enables the inspection mission autonomously and ensures a stable and collision-free flight.
引用
收藏
页码:1 / 23
页数:19
相关论文
共 38 条
[1]   An evolutionary approach to constrained path planning of an autonomous surface vehicle for maximizing the covered area of Ypacarai Lake [J].
Arzamendia, Mario ;
Gregor, Derlis ;
Gutierrez Reina, Daniel ;
Luis Toral, Sergio .
SOFT COMPUTING, 2019, 23 (05) :1723-1734
[2]   Unmanned Aerial Vehicle (UAV) for Monitoring Soil Erosion in Morocco [J].
d'Oleire-Oltmanns, Sebastian ;
Marzolff, Irene ;
Peter, Klaus Daniel ;
Ries, Johannes B. .
REMOTE SENSING, 2012, 4 (11) :3390-3416
[3]  
Dai JF, 2016, ADV NEUR IN, V29
[4]  
Forster C, 2014, IEEE INT CONF ROBOT, P15, DOI 10.1109/ICRA.2014.6906584
[5]   Optimal Trajectory Generation for Quadrotor Teach-and-Repeat [J].
Gao, Fei ;
Wang, Luqi ;
Wang, Kaixuan ;
Wu, William ;
Zhou, Boyu ;
Han, Luxin ;
Shen, Shaojie .
IEEE ROBOTICS AND AUTOMATION LETTERS, 2019, 4 (02) :1493-1500
[6]   Fast R-CNN [J].
Girshick, Ross .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :1440-1448
[7]   Rich feature hierarchies for accurate object detection and semantic segmentation [J].
Girshick, Ross ;
Donahue, Jeff ;
Darrell, Trevor ;
Malik, Jitendra .
2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, :580-587
[8]   Investigation of Fish-Eye Lenses for Small-UAV Aerial Photography [J].
Gurtner, Alex ;
Greer, Duncan G. ;
Glassock, Richard ;
Mejias, Luis ;
Walker, Rodney A. ;
Boles, Wageeh W. .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2009, 47 (03) :709-721
[9]  
Harabor D.D., 2011, P AAAI C ARTIFICIAL, V25, P1114, DOI [10.1609/aaai.v25i1.7994, DOI 10.1609/AAAI.V25I1.7994]
[10]   A FORMAL BASIS FOR HEURISTIC DETERMINATION OF MINIMUM COST PATHS [J].
HART, PE ;
NILSSON, NJ ;
RAPHAEL, B .
IEEE TRANSACTIONS ON SYSTEMS SCIENCE AND CYBERNETICS, 1968, SSC4 (02) :100-+