Calibration-Free Image-Based Trajectory Tracking Control of Mobile Robots With an Overhead Camera

被引:18
作者
Liang, Xinwu [1 ]
Wang, Hesheng [2 ,3 ]
Liu, Yun [4 ]
You, Bing [5 ]
Liu, Zhe [4 ]
Chen, Weidong [6 ]
机构
[1] Shanghai Jiao Tong Univ, Sch Aeronaut & Astronaut, Shanghai 200240, Peoples R China
[2] Shanghai Jiao Tong Univ, Key Lab Syst Control & Informat Proc, Key Lab Marine Intelligent Equipment & Syst, Dept Automat,Minist Educ, Shanghai 200240, Peoples R China
[3] Beijing Inst Technol, Beijing Adv Innovat Ctr Intelligent Robots & Syst, Beijing 100081, Peoples R China
[4] Chinese Univ Hong Kong, Dept Mech & Automat Engn, Hong Kong, Peoples R China
[5] Fujian Fuqing Nucl Power Co Ltd, Maintenance Dept 3, Fuqing 350300, Peoples R China
[6] Shanghai Jiao Tong Univ, Dept Automat, Shanghai 200240, Peoples R China
关键词
Cameras; Mobile robots; Calibration; Trajectory tracking; Visual servoing; Robustness; Calibration free; camera-parameter-independent; fixed camera; image-based control; trajectory tracking; VISION-BASED CONTROL; VISUAL TRACKING; CONTROL SCHEME; POSITION; LANDMARK; VEHICLES;
D O I
10.1109/TASE.2019.2951714
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
To make the controller implementation easier and to enhance the system robustness and control performance in the presence of the camera parameter uncertainties, it is very desired to develop vision-based control approaches without any offline or online camera calibration. In this article, we propose a new calibration-free image-based trajectory tracking control scheme for nonholonomic mobile robots with a truly uncalibrated fixed camera. By developing a novel camera-parameter-independent kinematic model, both offline and online camera calibration can be avoided in the proposed scheme, and any knowledge of the camera is not needed in the controller design. The proposed trajectory tracking control scheme can guarantee exponential convergence of the image position and velocity tracking errors. To illustrate the performance of the proposed scheme, experimental results are provided in this article. Note to Practitioners-This article was motivated by the vision-based motion control problem of mobile robots in uncalibrated environments. Existing vision-based motion control approaches for nonholonomic mobile robots generally depend on offline precise/coarse or online numerical/adaptive calibration of the camera intrinsic and extrinsic parameters and require precise or coarse knowledge of the camera in their implementation. This article presents a novel calibration-free image-based trajectory tracking control scheme, which can be implemented easily in real environments without any offline or online calibration of the camera parameters and can be used to efficiently control the motion of nonholonomic mobile robots with an arbitrarily placed and truly unknown overhead camera. Experimental results show that the proposed scheme can achieve satisfactory trajectory tracking control performance despite the lack of any knowledge about the camera intrinsic and extrinsic parameters and the presence of unknown camera lens distortions, and hence, can provide a simple but efficient solution to the vision-based motion control problem of nonholonomic mobile robots.
引用
收藏
页码:933 / 946
页数:14
相关论文
共 52 条
[1]   Visual servoing of mobile robots using non-central catadioptric cameras [J].
Aliakbarpour, Hadi ;
Tahri, Omar ;
Araujo, Helder .
ROBOTICS AND AUTONOMOUS SYSTEMS, 2014, 62 (11) :1613-1622
[2]   A single visual-servo controller of mobile robots with super-twisting control [J].
Becerra, H. M. ;
Hayet, J. B. ;
Saguees, C. .
ROBOTICS AND AUTONOMOUS SYSTEMS, 2014, 62 (11) :1623-1635
[3]   A Sliding-Mode-Control Law for Mobile Robots Based on Epipolar Visual Servoing From Three Views [J].
Becerra, H. M. ;
Lopez-Nicolas, G. ;
Saguees, C. .
IEEE TRANSACTIONS ON ROBOTICS, 2011, 27 (01) :175-183
[4]   Human Behavior-Based Target Tracking With an Omni-Directional Thermal Camera [J].
Benli, Emrah ;
Motai, Yuichi ;
Rogers, John .
IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS, 2019, 11 (01) :36-50
[5]   Optimal paths for landmark-based navigation by differential-drive vehicles with field-of-view constraints [J].
Bhattacharya, Sourabh ;
Murrieta-Cid, Rafael ;
Hutchinson, Seth .
IEEE TRANSACTIONS ON ROBOTICS, 2007, 23 (01) :47-59
[7]   Adaptive Jacobian vision based control for robots with uncertain depth information [J].
Cheah, Chien Chern ;
Liu, Chao ;
Slotine, Jean Jacques E. .
AUTOMATICA, 2010, 46 (07) :1228-1233
[8]   Homography-based visual servo tracking control of a wheeled mobile robot [J].
Chen, J ;
Dixon, WE ;
Dawson, DM ;
McIntyre, M .
IEEE TRANSACTIONS ON ROBOTICS, 2006, 22 (02) :406-415
[9]   Trifocal Tensor-Based Adaptive Visual Trajectory Tracking Control of Mobile Robots [J].
Chen, Jian ;
Jia, Bingxi ;
Zhang, Kaixiang .
IEEE TRANSACTIONS ON CYBERNETICS, 2017, 47 (11) :3784-3798
[10]   Topological Indoor Localization and Navigation for Autonomous Mobile Robot [J].
Cheng, Hongtai ;
Chen, Heping ;
Liu, Yong .
IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2015, 12 (02) :729-738