A novel data glove using inertial and magnetic sensors for motion capture and robotic arm-hand teleoperation

被引:41
作者
Fang, Bin [1 ]
Sun, Fuchun [1 ]
Liu, Huaping [1 ]
Guo, Di [1 ]
机构
[1] Tsinghua Univ, Tsinghua Natl Lab Informat Sci & Technol, State Key Lab Intelligent Technol & Syst, Beijing, Peoples R China
来源
INDUSTRIAL ROBOT-THE INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH AND APPLICATION | 2017年 / 44卷 / 02期
关键词
Sensors; Teleoperation; Virtual reality; Motion capture;
D O I
10.1108/IR-07-2016-0179
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Purpose - The purpose of this paper is to present a novel data glove which can capture the motion of the arm and hand by inertial and magnetic sensors. The proposed data glove is used to provide the information of the gestures and teleoperate the robotic arm-hand. Design/methodology/approach - The data glove comprises 18 low-cost inertial and magnetic measurement units (IMMUs) which not only make up the drawbacks of traditional data glove that only captures the incomplete gesture information but also provide a novel scheme of the robotic arm-hand teleoperation. The IMMUs are compact and small enough to wear on the upper arm, forearm, palm and fingers. The calibration method is proposed to improve the accuracy of measurements of units, and the orientations of each IMMU are estimated by a two-step optimal filter. The kinematic models of the arm, hand and fingers are integrated into the entire system to capture the motion gesture. A positon algorithm is also deduced to compute the positions of fingertips. With the proposed data glove, the robotic arm-hand can be teleoperated by the human arm, palm and fingers, thus establishing a novel robotic arm-hand teleoperation scheme. Findings - Experimental results show that the proposed data glove can accurately and fully capture the fine gesture. Using the proposed data glove as the multiple input device has also proved to be a suitable teleoperating robotic arm-hand system. Originality/value - Integrated with 18 low-cost and miniature IMMUs, the proposed data glove can give more information of the gesture than existing devices. Meanwhile, the proposed algorithms for motion capture determine the superior results. Furthermore, the accurately captured gestures can efficiently facilitate a novel teleoperation scheme to teleoperate the robotic arm-hand.
引用
收藏
页码:155 / 165
页数:11
相关论文
共 25 条
[1]  
[Anonymous], J NEUROENGINEERING R
[2]  
Cavallo Filippo, 2013, IEEE Int Conf Rehabil Robot, V2013, P6650466, DOI 10.1109/ICORR.2013.6650466
[3]   Two-step optimal filter design for the low-cost attitude and heading reference systems [J].
Chou, Wusheng ;
Fang, Bin ;
Ding, Li ;
Ma, Xin ;
Guo, Xiaoqi .
IET SCIENCE MEASUREMENT & TECHNOLOGY, 2013, 7 (04) :240-248
[4]   A survey of glove-based systems and their applications [J].
Dipietro, Laura ;
Sabatini, Angelo M. ;
Dario, Paolo .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART C-APPLICATIONS AND REVIEWS, 2008, 38 (04) :461-482
[5]   Human motion capture sensors and analysis in robotics [J].
Field, Matthew ;
Pan, Zengxi ;
Stirling, David ;
Naghdy, Fazel .
INDUSTRIAL ROBOT-THE INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH AND APPLICATION, 2011, 38 (02) :163-171
[6]  
Invense, 2015, MPU 9250 7 AX MEMS M
[7]  
KAPANDJI AI, 2006, ARTICULATE PHYSL
[8]  
Kim JH, 2009, 2009 IEEE INTERNATIONAL SYMPOSIUM ON MODELING, ANALYSIS & SIMULATION OF COMPUTER AND TELECOMMUNICATION SYSTEMS (MASCOTS), P133
[9]   Miniature Low-Power Inertial Sensors: Promising Technology for Implantable Motion Capture Systems [J].
Lambrecht, Joris M. ;
Kirsch, Robert F. .
IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2014, 22 (06) :1138-1147
[10]   Data Glove Embedded with 6-DOF Inertial Sensors for Hand Rehabilitation [J].
Lin, Bor-Shing ;
Lee, I-Jung ;
Hsiao, Pei-Chi ;
Yang, Shu-Yu ;
Chou, Willy .
2014 TENTH INTERNATIONAL CONFERENCE ON INTELLIGENT INFORMATION HIDING AND MULTIMEDIA SIGNAL PROCESSING (IIH-MSP 2014), 2014, :25-28