Autonomous UAV Trail Navigation with Obstacle Avoidance Using Deep Neural Networks

被引:39
作者
Back, Seungho [1 ]
Cho, Gangik [2 ]
Oh, Jinwoo [2 ]
Tran, Xuan-Toa [3 ]
Oh, Hyondong [2 ]
机构
[1] NearthLab, Seoul 06246, South Korea
[2] Ulsan Natl Inst Sci & Technol, Dept Mech Engn, Ulsan 44919, South Korea
[3] Nguyen Tat Thanh Univ, NTT Hitech Inst, 300A Nguyen Tat Thanh St, Ho Chi Minh City, Vietnam
基金
新加坡国家研究基金会;
关键词
Autonomous navigation; Obstacle avoidance; Deep learning; Trail following; Unmanned aerial vehicle; VISION; ROBOT; FLIGHT;
D O I
10.1007/s10846-020-01254-5
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper proposes a vision-based bike trail following approach with obstacle avoidance using CNN (Convolutional Neural Network) for the UAV (Unmanned Aerial Vehicle). The UAV is controlled to follow a given trail while keeping its position near the center of the trail using the CNN. Also, to return to the original path when the UAV goes out of the path or the camera misses the trail due to disturbances such as wind, the control commands from the CNN are stored for a certain duration of time and used for recovering from such disturbances. To avoid obstacles during the trail navigation, the optical flow computed with another CNN is used to determine the safe maneuver. By combining these methods of i) trail following, ii) disturbance recovery, and iii) obstacle avoidance, the UAV deals with various situations encountered when traveling on the trail. The feasibility and performance of the proposed approach are verified through realistic simulations and flight experiments in real-world environments.
引用
收藏
页码:1195 / 1211
页数:17
相关论文
共 40 条
[1]   Accurate Natural Trail Detection Using a Combination of a Deep Neural Network and Dynamic Programming [J].
Adhikari, Shyam Prasad ;
Yang, Changju ;
Slot, Krzysztof ;
Kim, Hyongsuk .
SENSORS, 2018, 18 (01)
[2]   Inverse optical flow based guidance for UAV navigation through urban canyons [J].
Agrawal, Pooja ;
Ratnoo, Ashwini ;
Ghose, Debasish .
AEROSPACE SCIENCE AND TECHNOLOGY, 2017, 68 :163-178
[3]  
Al-Kaff A, 2016, IEEE INT VEH SYM, P92, DOI 10.1109/IVS.2016.7535370
[4]  
[Anonymous], 2018, IEEE RSJ INT C INT R
[5]  
[Anonymous], 2011, INT J AERONAUTICAL S, DOI DOI 10.5139/IJASS.2011.12.3.252
[6]  
Burton A., 1978, THINKING PERSPECTIVE
[7]   Vision-Based Obstacle Avoidance Strategies for MAVs Using Optical Flows in 3-D Textured Environments [J].
Cho, Gangik ;
Kim, Jongyun ;
Oh, Hyondong .
SENSORS, 2019, 19 (11)
[8]  
Dickmanns, 2007, DYNAMIC VISION PERCE
[9]  
Dickmanns E. D., 1994, Proceedings of the Intelligent Vehicles '94 Symposium (Cat. No.94TH8011), P68, DOI 10.1109/IVS.1994.639472
[10]  
Dickmanns E. D., 1987, Proceedings of the SPIE - The International Society for Optical Engineering, V727, P161, DOI 10.1117/12.937795