Efficient Optical Flow and Stereo Vision for Velocity Estimation and Obstacle Avoidance on an Autonomous Pocket Drone

被引:139
作者
McGuire, Kimberly [1 ]
de Croon, Guido [1 ]
De Wagter, Christophe [1 ]
Tuyls, Karl [2 ]
Kappen, Hilbert [3 ]
机构
[1] Delft Univ Technol, Fac Aerosp Engn, NL-2628 CD Delft, Netherlands
[2] Univ Liverpool, Dept Comp Sci, Liverpool L69 3BX, Merseyside, England
[3] Radboud Univ Nijmegen, Fac Sci, NL-6525 HP Nijmegen, Netherlands
关键词
Aerial systems: Perception and autonomy; autonomous vehicle navigation; micro/nano robots; visual-based navigation; EGO-MOTION ESTIMATION;
D O I
10.1109/LRA.2017.2658940
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
Micro Aerial Vehicles (FOV) are very suitable for flying in indoor environments, but autonomous navigation is challenging due to their strict hardware limitations. This paper presents a highly efficient computer vision algorithm called Edge-FS for the determination of velocity and depth. It runs at 20 Hz on a 4 g stereo camera with an embedded STM32F4 microprocessor (168 MHz, 192 kB) and uses edge distributions to calculate optical flow and stereo disparity. The stereo-based distance estimates are used to scale the optical flow in order to retrieve the drone's velocity. The velocity and depth measurements are used for fully autonomous flight of a 40 g pocket drone only relying on on-board sensors. This method allows the MAV to control its velocity and avoid obstacles.
引用
收藏
页码:1070 / 1076
页数:7
相关论文
共 24 条
[1]  
[Anonymous], 2001, PYRAMIDAL IMPLEMENTA
[2]   A method for ego-motion estimation in micro-hovering platforms flying in very cluttered environments [J].
Briod, Adrien ;
Zufferey, Jean-Christophe ;
Floreano, Dario .
AUTONOMOUS ROBOTS, 2016, 40 (05) :789-803
[3]  
De Wagter C, 2014, IEEE INT CONF ROBOT, P4982, DOI 10.1109/ICRA.2014.6907589
[4]  
Dunkley O., 2014, P AER OP SOURC ROB W, P2
[5]   Two-frame motion estimation based on polynomial expansion [J].
Farnebäck, G .
IMAGE ANALYSIS, PROCEEDINGS, 2003, 2749 :363-370
[6]  
Geiger A, 2011, IEEE INT VEH SYM, P963, DOI 10.1109/IVS.2011.5940405
[7]   Nonlinear ego-motion estimation from optical flow for online control of a quadrotor UAV [J].
Grabe, Volker ;
Buelthoff, Heinrich H. ;
Scaramuzza, Davide ;
Giordano, Paolo Robuffo .
INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH, 2015, 34 (08) :1114-1135
[8]   Optic-flow-based collision avoidance - Applications using a hybrid MAV [J].
Green, William E. ;
Oh, Paul Y. .
IEEE ROBOTICS & AUTOMATION MAGAZINE, 2008, 15 (01) :96-103
[9]  
Hirschmüller H, 2008, IEEE T PATTERN ANAL, V30, P328, DOI 10.1109/TPAMl.2007.1166
[10]  
Honegger D, 2013, IEEE INT CONF ROBOT, P1736, DOI 10.1109/ICRA.2013.6630805