Obstacle Avoidance of a UAV Using Fast Monocular Depth Estimation for a Wide Stereo Camera

被引:4
作者
Cho, Euihyeon [1 ]
Kim, Hyeongjin [1 ]
Kim, Pyojin [2 ]
Lee, Hyeonbeom [3 ]
机构
[1] Kyungpook Natl Univ, Sch Elect & Elect Engn, Daegu 41566, South Korea
[2] Gwangju Inst Sci & Technol GIST, Sch Mech & Robot Engn, Gwangju, South Korea
[3] Ajou Univ, Dept Mech Engn, Suwon 16499, South Korea
基金
新加坡国家研究基金会;
关键词
Estimation; Cameras; Accuracy; Collision avoidance; Convolution; Prediction algorithms; Decoding; Depth estimation; obstacle avoidance; quadrotor; wide stereo camera;
D O I
10.1109/TIE.2024.3429611
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this study, we designed an obstacle avoidance algorithm for a quadrotor unmanned aerial vehicle (UAV) equipped with a wide field-of-view (FOV) stereo camera, utilizing a learning-based depth estimation approach. Depth estimation using monocular cameras is gaining interest as a viable alternative to large and heavy sensors, such as light detection and ranging (LiDAR) sensors. However, deep learning-based depth estimation has low accuracy unless the depth estimation is done in an environment similar to that of the training data. Therefore, we first designed a depth estimation network for a wide-FOV stereo camera using two cameras. Then, we estimated the depth image using a convolutional neural network and improved the accuracy using stereo matching. We used the estimated depth images to develop a simple behavior-arbitration-based control algorithm that steers the quadrotor away from 3-D obstacles. We conducted simulations and experiments using a real drone in an indoor and outdoor environment to validate our proposed algorithm. An analysis of the experimental results showed that the proposed method could be employed for navigation in cluttered environments.
引用
收藏
页码:1763 / 1773
页数:11
相关论文
共 30 条
[1]   AdaBins: Depth Estimation Using Adaptive Bins [J].
Bhat, Shariq Farooq ;
Alhashim, Ibraheem ;
Wonka, Peter .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :4008-4017
[2]  
Chakravarty Punarjay, 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA), P6369, DOI 10.1109/ICRA.2017.7989752
[3]   End-to-End Learning for Omnidirectional Stereo Matching With Uncertainty Prior [J].
Won, Changhee ;
Ryu, Jongbin ;
Lim, Jongwoo .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (11) :3850-3862
[4]   Vision-Based Obstacle Avoidance Strategies for MAVs Using Optical Flows in 3-D Textured Environments [J].
Cho, Gangik ;
Kim, Jongyun ;
Oh, Hyondong .
SENSORS, 2019, 19 (11)
[5]   Automatic obstacle avoidance of quadrotor UAV via CNN-based learning [J].
Dai, Xi ;
Mao, Yuxin ;
Huang, Tianpeng ;
Qin, Na ;
Huang, Deqing ;
Li, Yanan .
NEUROCOMPUTING, 2020, 402 :346-358
[6]   Graph-based subterranean exploration path planning using aerial and legged robots [J].
Dang, Tung ;
Tranzatto, Marco ;
Khattak, Shehryar ;
Mascarich, Frank ;
Alexis, Kostas ;
Hutter, Marco .
JOURNAL OF FIELD ROBOTICS, 2020, 37 (08) :1363-1388
[7]  
Eigen D, 2014, ADV NEUR IN, V27
[8]   Dynamic obstacle avoidance for quadrotors with event cameras [J].
Falanga, Davide ;
Kleber, Kevin ;
Scaramuzza, Davide .
SCIENCE ROBOTICS, 2020, 5 (40)
[9]  
Geiger A, 2011, LECT NOTES COMPUT SC, V6492, P25, DOI 10.1007/978-3-642-19315-6_3
[10]   Digging Into Self-Supervised Monocular Depth Estimation [J].
Godard, Clement ;
Mac Aodha, Oisin ;
Firman, Michael ;
Brostow, Gabriel .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :3827-3837