3D human gesture capturing and recognition by the IMMU-based data glove

被引:77
作者
Fang, Bin [1 ]
Sun, Fuchun [1 ]
Liu, Huaping [1 ]
Liu, Chunfang [1 ]
机构
[1] Tsinghua Univ, Tsinghua Natl Lab Informat Sci & Technol, Dept Comp Sci & Technol, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
Gestures recognition; Capture; Inertial and magnetic measurement unit; Extreme learning machine; EXTREME LEARNING-MACHINE; SENSORS;
D O I
10.1016/j.neucom.2017.02.101
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Gestures recognition provides an intelligent, natural, and convenient way for human-robot interaction (HRI). This paper presents a novel data glove for gestures capturing and recognition based on inertial and magnetic measurement units (IMMUs), which are made up of three-axis gyroscopes, three-axis accelerometers and three-axis magnetometers. The proposed data glove has eighteen low-cost IMMUs, which are compact and small enough to wear. The gestures included the three-dimensional motions of arm, palm and fingers are completely captured by the data glove. Meanwhile, we attempt to use extreme learning machine (ELM) for gesture recognition which has not found yet in the relevant application. The ELM-based recognition methods for both static gestures and dynamic gestures are respectively presented. The experimental results of gestures capturing and recognition verify the effectiveness of the proposed methods. (C) 2017 Elsevier B.V. All rights reserved.
引用
收藏
页码:198 / 207
页数:10
相关论文
共 26 条
[1]  
[Anonymous], J NEUROENGINEERING R
[2]   The sample complexity of pattern classification with neural networks: The size of the weights is more important than the size of the network [J].
Bartlett, PL .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1998, 44 (02) :525-536
[3]  
Belgioioso G, 2014, IEEE DECIS CONTR P, P4899, DOI 10.1109/CDC.2014.7040154
[4]   Sensors for Gesture Recognition Systems [J].
Berman, Sigal ;
Stern, Helman .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART C-APPLICATIONS AND REVIEWS, 2012, 42 (03) :277-290
[5]  
Cavallo Filippo, 2013, IEEE Int Conf Rehabil Robot, V2013, P6650466, DOI 10.1109/ICORR.2013.6650466
[6]   Two-step optimal filter design for the low-cost attitude and heading reference systems [J].
Chou, Wusheng ;
Fang, Bin ;
Ding, Li ;
Ma, Xin ;
Guo, Xiaoqi .
IET SCIENCE MEASUREMENT & TECHNOLOGY, 2013, 7 (04) :240-248
[7]   A survey of glove-based systems and their applications [J].
Dipietro, Laura ;
Sabatini, Angelo M. ;
Dario, Paolo .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART C-APPLICATIONS AND REVIEWS, 2008, 38 (04) :461-482
[8]   Extreme Learning Machine for Regression and Multiclass Classification [J].
Huang, Guang-Bin ;
Zhou, Hongming ;
Ding, Xiaojian ;
Zhang, Rui .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2012, 42 (02) :513-529
[9]   Extreme learning machines: a survey [J].
Huang, Guang-Bin ;
Wang, Dian Hui ;
Lan, Yuan .
INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2011, 2 (02) :107-122
[10]   Optimization method based extreme learning machine for classification [J].
Huang, Guang-Bin ;
Ding, Xiaojian ;
Zhou, Hongming .
NEUROCOMPUTING, 2010, 74 (1-3) :155-163