A comprehensive review of robot intelligent grasping based on tactile perception

被引:13
作者
Li, Tong [1 ]
Yan, Yuhang [1 ]
Yu, Chengshun [1 ]
An, Jing [1 ]
Wang, Yifan [2 ]
Chen, Gang [1 ]
机构
[1] Beijing Univ Posts & Telecommun, Sch Modern Post, Sch Automat, Beijing 100876, Peoples R China
[2] Beijing Univ Posts & Telecommun, Sch Artificial Intelligence, Beijing 100876, Peoples R China
基金
中国国家自然科学基金;
关键词
Tactile sensor; Tactile perception; Tactile -visual fusion; Robotic grasping; SLIP DETECTION; OBJECT RECOGNITION; POSE ESTIMATION; FUSION; INFORMATION; DESIGN; SENSOR; TOUCH; MODELS; MANIPULATION;
D O I
10.1016/j.rcim.2024.102792
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
The Advancements in tactile sensors and machine learning techniques open new opportunities for achieving intelligent grasping in robotics. Traditional robot is limited in its ability to perform autonomous grasping in unstructured environments. Although the existing robotic grasping method enhances the robot's understanding of its environment by incorporating visual perception, it still lacks the capability for force perception and force adaptation. Therefore, tactile sensors are integrated into robot hands to enhance the robot's adaptive grasping capabilities in various complex scenarios by tactile perception. This paper primarily discusses the adaption of different types of tactile sensors in robotic grasping operations and grasping algorithms based on them. By dividing robotic grasping operations into four stages: grasping generation, robot planning, grasping state discrimination, and grasping destabilization adjustment, a further review of tactile-based and tactile-visual fusion methods is applied in related stages. The characteristics of these methods are comprehensively compared with different dimensions and indicators. Additionally, the challenges encountered in robotic tactile perception is summarized and insights into potential directions for future research are offered. This review is aimed for offering researchers and engineers a comprehensive understanding of the application of tactile perception techniques in robotic grasping operations, as well as facilitating future work to further enhance the intelligence of robotic grasping.
引用
收藏
页数:25
相关论文
共 245 条
[1]   A Deep Learning Framework for Tactile Recognition of Known as Well as Novel Objects [J].
Abderrahmane, Zineb ;
Ganesh, Gowrishankar ;
Crosnier, Andre ;
Cherubini, Andrea .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2020, 16 (01) :423-432
[2]  
Akinola Wu I., 2019, arXiv
[3]   Highly Stretchable Additively Manufactured Capacitive Proximity and Tactile Sensors for Soft Robotic Systems [J].
Alshawabkeh, Mohammad ;
Alagi, Hosam ;
Navarro, Stefan Escaida ;
Duriez, Christian ;
Hein, Bjorn ;
Zangl, Hubert ;
Faller, Lisa-Marie .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
[4]  
Alvarez D., 2019, IB ROB C PORT PORT 2, P184
[5]   Tactile-Based In-Hand Object Pose Estimation [J].
Alvarez, David ;
Roa, Maximo A. ;
Moreno, Luis .
ROBOT 2017: THIRD IBERIAN ROBOTICS CONFERENCE, VOL 2, 2018, 694 :716-728
[6]   Deep Gated Multi-modal Learning: In-hand Object Pose Changes Estimation using Tactile and Image Data [J].
Anzai, Tomoki ;
Takahashi, Iyuki .
2020 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2020, :9361-9368
[7]   Learning Haptic-Based Object Pose Estimation for In-Hand Manipulation Control With Underactuated Robotic Hands [J].
Azulay, Osher ;
Ben-David, Inbar ;
Sintov, Avishai .
IEEE TRANSACTIONS ON HAPTICS, 2023, 16 (01) :73-85
[8]   Fusion of tactile and visual information in deep learning models for object recognition [J].
Babadian, Reza Pebdani ;
Faez, Karim ;
Amiri, Mahmood ;
Falotico, Egidio .
INFORMATION FUSION, 2023, 92 :313-325
[9]   Object Detection Recognition and Robot Grasping Based on Machine Learning: A Survey [J].
Bai, Qiang ;
Li, Shaobo ;
Yang, Jing ;
Song, Qisong ;
Li, Zhiang ;
Zhang, Xingxing .
IEEE ACCESS, 2020, 8 :181855-181879
[10]   Multilayer-perceptron-based Slip Detection Algorithm Using Normal Force Sensor Arrays [J].
Bamshad, Hamid ;
Lee, Sangwon ;
Son, Kyungchan ;
Jeong, Hyemi ;
Kwon, Geonwoo ;
Yang, Hyunseok .
SENSORS AND MATERIALS, 2023, 35 (02) :365-376