A survey Of learning-Based control of robotic visual servoing systems

被引:40
作者
Wu, Jinhui [1 ]
Jin, Zhehao [1 ]
Liu, Andong [1 ]
Yu, Li [1 ]
Yang, Fuwen [2 ]
机构
[1] Zhejiang Univ Technol, Coll Informat Engn, Hangzhou, Peoples R China
[2] Griffith Univ Gold Coast, Sch Engn & Built Environm, Southport, Qld 4222, Australia
来源
JOURNAL OF THE FRANKLIN INSTITUTE-ENGINEERING AND APPLIED MATHEMATICS | 2022年 / 359卷 / 01期
基金
中国国家自然科学基金;
关键词
EYE-TO-HAND; NEURAL-NETWORK; PREDICTIVE CONTROL; MOBILE ROBOTS; TRAJECTORY TRACKING; MANIPULATOR; STABILIZATION; CONSTRAINT; TASK;
D O I
10.1016/j.jfranklin.2021.11.009
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Major difficulties and challenges of modern robotics systems focus on how to give robots self-learning and self-decision-making ability. Visual servoing control strategy is an important strategy of robotic systems to perceive the environment via the vision. The vision can guide new robotic systems to complete more complicated tasks in complex working environments. This survey aims at describing the state-of-the-art learning-based algorithms, especially those algorithms that combine with model predictive control (MPC) used in visual servoing systems, and providing some pioneering and advanced references with several numerical simulations. The general modeling methods of visual servo and the influence of traditional control strategies on robotic visual servoing systems are introduced. The advantages of introducing neural-network-based algorithms and reinforcement-learning-based algorithms into the systems are discussed. Finally, according to the existing research progress and references, the future directions of robotic visual servoing systems are summarized and prospected. (C) 2021 The Franklin Institute. Published by Elsevier Ltd. All rights reserved.
引用
收藏
页码:556 / 577
页数:22
相关论文
共 98 条
[81]   Visual Servoing of Soft Robot Manipulator in Constrained Environments With an Adaptive Controller [J].
Wang, Hesheng ;
Yang, Bohan ;
Liu, Yuting ;
Chen, Weidong ;
Liang, Xinwu ;
Pfeifer, Rolf .
IEEE-ASME TRANSACTIONS ON MECHATRONICS, 2017, 22 (01) :41-50
[82]   Dynamics-Level Finite-Time Fuzzy Monocular Visual Servo of an Unmanned Surface Vehicle [J].
Wang, Ning ;
He, Hongkun .
IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2020, 67 (11) :9648-9658
[83]   QUASI-MIN-MAX MODEL PREDICTIVE CONTROL FOR IMAGE-BASED VISUAL SERVOING WITH TENSOR PRODUCT MODEL TRANSFORMATION [J].
Wang, T. T. ;
Xie, W. F. ;
Liu, G. D. ;
Zhao, Y. M. .
ASIAN JOURNAL OF CONTROL, 2015, 17 (02) :402-416
[84]   A Hybrid Visual Servo Controller for Robust Grasping by Wheeled Mobile Robots [J].
Wang, Ying ;
Lang, Haoxiang ;
de Silva, Clarence W. .
IEEE-ASME TRANSACTIONS ON MECHATRONICS, 2010, 15 (05) :757-769
[85]   Visual Servo-Collision Avoidance Hybrid Task by Considering Detection and Localization of Contact for a Soft Manipulator [J].
Wang, Yuxin ;
Wang, Hesheng ;
Liu, Zhe ;
Chen, Weidong .
IEEE-ASME TRANSACTIONS ON MECHATRONICS, 2020, 25 (03) :1310-1321
[86]   Distributed Lyapunov-Based Model Predictive Formation Tracking Control for Autonomous Underwater Vehicles Subject to Disturbances [J].
Wei, Henglai ;
Shen, Chao ;
Shi, Yang .
IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2021, 51 (08) :5198-5208
[87]   Two Projection Neural Networks With Reduced Model Complexity for Nonlinear Programming [J].
Xia, Youshen ;
Wang, Jun ;
Guo, Wenzhong .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2020, 31 (06) :2020-2029
[88]   Global exponential stability of recurrent neural networks for solving optimization and related problems [J].
Xia, YS ;
Wang, J .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2000, 11 (04) :1017-1022
[89]  
Xu M, 2019, 2019 IEEE INTERNATIONAL CONFERENCE ON MECHATRONICS AND AUTOMATION (ICMA), P444, DOI [10.1109/ICMA.2019.8816420, 10.1109/icma.2019.8816420]
[90]   Learning-Based Predictive Control for Discrete-Time Nonlinear Systems With Stochastic Disturbances [J].
Xu, Xin ;
Chen, Hong ;
Lian, Chuanqiang ;
Li, Dazi .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2018, 29 (12) :6202-6213