Dynamic Illumination Optical Flow Computing for Sensing Multiple Mobile Robots From a Drone

被引:16
作者
Cai, Shengze [1 ,2 ]
Huang, Yongbin [1 ,2 ]
Ye, Bo [1 ,2 ]
Xu, Chao [1 ,2 ]
机构
[1] Zhejiang Univ, State Key Lab Ind Control Technol, Hangzhou 310027, Zhejiang, Peoples R China
[2] Zhejiang Univ, Inst Cyber Syst & Control, Hangzhou 310027, Zhejiang, Peoples R China
来源
IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS | 2018年 / 48卷 / 08期
基金
中国国家自然科学基金;
关键词
Dynamic illumination; international aerial robotics competition (IARC); motion estimation; object detection; optical flow; MOTION ESTIMATION; DENSE ESTIMATION; IMAGE SEQUENCE; SEGMENTATION; FIELDS;
D O I
10.1109/TSMC.2017.2709404
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we consider a motion sense problem motivated by the International Aerial Robotics Competition Mission-7, where an aerial robot is required to provide detection and estimation about mobile vehicles. Dense optical flow computing is employed first to provide a velocity field from image sequences. Then, region growing based on the optical flow field is used to extract moving objects on the background, and motion estimation is eventually achieved while both camera and objects are moving. In addition, classical optical flow techniques do not work in the competition since there may be illumination changes, such as flashlights and reflections in the arena. To deal with this problem, the procedures of the brightness constancy relaxation and intensity normalization are combined in the optical flow algorithm. Experimental results have demonstrated the robustness against varying illumination. The proposed approach can provide motion estimation results of acceptable accuracy for several benchmark data sets and image sequences generated with micro aerial vehicles.
引用
收藏
页码:1370 / 1382
页数:13
相关论文
共 32 条
[1]   A COMPUTATIONAL FRAMEWORK AND AN ALGORITHM FOR THE MEASUREMENT OF VISUAL-MOTION [J].
ANANDAN, P .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 1989, 2 (03) :283-310
[2]  
Aubin J.-P., 2011, Applied Functional Analysis
[3]   An optimal control approach to the optical flow problem [J].
Barbu, Viorel ;
Marinoschi, Gabriela .
SYSTEMS & CONTROL LETTERS, 2016, 87 :1-9
[4]   Optical 3D laser measurement system for navigation of autonomous mobile robot [J].
Basaca-Preciado, Luis C. ;
Sergiyenko, Oleg Yu. ;
Rodriguez-Quinonez, Julio C. ;
Garcia, Xochitl ;
Tyrsa, Vera V. ;
Rivas-Lopez, Moises ;
Hernandez-Balbuena, Daniel ;
Mercorelli, Paolo ;
Podrygalo, Mikhail ;
Gurko, Alexander ;
Tabakova, Irina ;
Starostenko, Oleg .
OPTICS AND LASERS IN ENGINEERING, 2014, 54 :159-169
[5]   The computation of optical flow [J].
Beauchemin, SS ;
Barron, JL .
ACM COMPUTING SURVEYS, 1995, 27 (03) :433-467
[6]   The robust estimation of multiple motions: Parametric and piecewise-smooth flow fields [J].
Black, MJ ;
Anandan, P .
COMPUTER VISION AND IMAGE UNDERSTANDING, 1996, 63 (01) :75-104
[7]   MOTION SEGMENTATION AND QUALITATIVE DYNAMIC SCENE ANALYSIS FROM AN IMAGE SEQUENCE [J].
BOUTHEMY, P ;
FRANCOIS, E .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 1993, 10 (02) :157-182
[8]   High accuracy optical flow estimation based on a theory for warping [J].
Brox, T ;
Bruhn, A ;
Papenberg, N ;
Weickert, J .
COMPUTER VISION - ECCV 2004, PT 4, 2004, 2034 :25-36
[9]   Three-Dimensional Position and Velocity Regulation of a Quad-Rotorcraft Using Optical Flow [J].
Carrillo, Luis Rodolfo Garcia ;
Fantoni, Isabelle ;
Rondon, Eduardo ;
Dzul, Alejandro .
IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS, 2015, 51 (01) :358-371
[10]   Object Tracking via Temporal Consistency Dictionary Learning [J].
Cheng, Xu ;
Zhang, Yifeng ;
Cui, Jinshi ;
Zhou, Lin .
IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2017, 47 (04) :628-638