Computer vision-based hand gesture recognition for human-robot interaction: a review

被引:71
作者
Qi, Jing [1 ,2 ]
Ma, Li [1 ,2 ]
Cui, Zhenchao [1 ,2 ]
Yu, Yushu [3 ]
机构
[1] Hebei Univ, Sch Cyber Secur & Comp, Qiyi East Rd, Baoding 071002, Hebei, Peoples R China
[2] Hebei Univ, Machine Vis Engn Res Ctr Hebei Prov, Qiyi East Rd, Baoding 071002, Hebei, Peoples R China
[3] Beijing Inst Technol, Sch Mechatron Engn, Zhongguancun South St, Beijing 100081, Peoples R China
基金
中国国家自然科学基金;
关键词
Hand gesture recognition; RGB-D camera; Human-robot interaction; Robot; PETROGRAPHIC IMAGES; EDGE-DETECTION; SEGMENTATION;
D O I
10.1007/s40747-023-01173-6
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
As robots have become more pervasive in our daily life, natural human-robot interaction (HRI) has had a positive impact on the development of robotics. Thus, there has been growing interest in the development of vision-based hand gesture recognition for HRI to bridge human-robot barriers. The aim is for interaction with robots to be as natural as that between individuals. Accordingly, incorporating hand gestures in HRI is a significant research area. Hand gestures can provide natural, intuitive, and creative methods for communicating with robots. This paper provides an analysis of hand gesture recognition using both monocular cameras and RGB-D cameras for this purpose. Specifically, the main process of visual gesture recognition includes data acquisition, hand gesture detection and segmentation, feature extraction and gesture classification, which are discussed in this paper. Experimental evaluations are also reviewed. Furthermore, algorithms of hand gesture recognition for human-robot interaction are examined in this study. In addition, the advances required for improvement in the present hand gesture recognition systems, which can be applied for effective and efficient human-robot interaction, are discussed.
引用
收藏
页码:1581 / 1606
页数:26
相关论文
共 219 条
[71]  
Haykin S. S., 2001, Kalman Filtering and Neural Networks, V284
[72]   Computer Vision-Based Real-Time 3D Gesture Recognition Using Depth Image [J].
Heickal, Hasnain ;
Zhang, Tao ;
Hasanuzzaman, Md .
INTERNATIONAL JOURNAL OF IMAGE AND GRAPHICS, 2015, 15 (01)
[73]  
HelenJenefa R, 2018, INT C COMP NETW BIG, P771
[74]   Supervised learning classifiers for Arabic gestures recognition using Kinect V2 [J].
Hisham, Basma ;
Hamouda, Alaa .
SN APPLIED SCIENCES, 2019, 1 (07)
[75]  
Hoque S.M.A., 2018, P INT C INN ENG TECH, P1, DOI [10.1109/CIET.2018.8660916, DOI 10.1109/CIET.2018.8660916]
[76]   Novel Haar features for real-time hand gesture recognition using SVM [J].
Hsieh, Chen-Chiung ;
Liou, Dung-Hua .
JOURNAL OF REAL-TIME IMAGE PROCESSING, 2015, 10 (02) :357-370
[77]   Virtual interaction and manipulation control of a hexacopter through hand gesture recognition from a data glove [J].
Huang, Haiming ;
Wu, Di'en ;
Liang, Zehao ;
Sun, Fuchun ;
Dong, Mingjie .
ROBOTICA, 2022, 40 (12) :4375-4387
[78]  
Hui Zhang, 2011, 2011 International Conference on Electronic & Mechanical Engineering and Information Technology (EMEIT 2011), P178, DOI 10.1109/EMEIT.2011.6022891
[79]   An Automatic Arabic Sign Language Recognition System (ArSLRS) [J].
Ibrahim, Nada B. ;
Selim, Mazen M. ;
Zayed, Hala H. .
JOURNAL OF KING SAUD UNIVERSITY-COMPUTER AND INFORMATION SCIENCES, 2018, 30 (04) :470-477
[80]  
Islam M., 2020, SN Comput. Sci, V1, P1, DOI [10.1007/s42979-020-00223-x, DOI 10.1007/S42979-020-00223-X]