Robust Hand Motion Tracking through Data Fusion of 5DT Data Glove and Nimble VR Kinect Camera Measurements

被引:26
作者
Arkenbout, Ewout A. [1 ]
de Winter, Joost C. F. [1 ]
Breedveld, Paul [1 ]
机构
[1] Delft Univ Technol, Fac Mech Maritime & Mat Engn, Dept Biomech Engn, NL-2628 CD Delft, Netherlands
关键词
Human-computer interaction; Kalman filter; data fusion; gestures; finger joint angle measurements; sensor redundancy; HUMAN-COMPUTER INTERACTION; VIRTUAL-REALITY; OPERATING-ROOM; BOX TRAINER; PERFORMANCE; FEEDBACK; VISION; SURGERY; TIME; SIMULATION;
D O I
10.3390/s151229868
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Vision based interfaces for human computer interaction have gained increasing attention over the past decade. This study presents a data fusion approach of the Nimble VR vision based system, using the Kinect camera, with the contact based 5DT Data Glove. Data fusion was achieved through a Kalman filter. The Nimble VR and filter output were compared using measurements performed on (1) a wooden hand model placed in various static postures and orientations; and (2) three differently sized human hands during active finger flexions. Precision and accuracy of joint angle estimates as a function of hand posture and orientation were determined. Moreover, in light of possible self-occlusions of the fingers in the Kinect camera images, data completeness was assessed. Results showed that the integration of the Data Glove through the Kalman filter provided for the proximal interphalangeal (PIP) joints of the fingers a substantial improvement of 79% in precision, from 2.2 deg to 0.9 deg. Moreover, a moderate improvement of 31% in accuracy (being the mean angular deviation from the true joint angle) was established, from 24 deg to 17 deg. The metacarpophalangeal (MCP) joint was relatively unaffected by the Kalman filter. Moreover, the Data Glove increased data completeness, thus providing a substantial advantage over the sole use of the Nimble VR system.
引用
收藏
页码:31644 / 31671
页数:28
相关论文
共 73 条
[1]   Exploring Direct 3D Interaction for Full Horizontal Parallax Light Field Displays Using Leap Motion Controller [J].
Adhikarla, Vamsi Kiran ;
Sodnik, Jaka ;
Szolgay, Peter ;
Jakus, Grega .
SENSORS, 2015, 15 (04) :8642-8663
[2]   Proficiency-based virtual reality training significantly reduces the error rate for residents during their first 10 laparoscopic cholecystectomies [J].
Ahlberg, Gunnar ;
Enochsson, Lars ;
Gallagher, Anthony G. ;
Hedman, Leif ;
Hogman, Christian ;
McClusky, David A., III ;
Ramel, Stig ;
Smith, C. Daniel ;
Arvidsson, Dag .
AMERICAN JOURNAL OF SURGERY, 2007, 193 (06) :797-804
[3]  
[Anonymous], DAT GLOV
[4]  
[Anonymous], 2001, P SIGGRAPH
[5]  
[Anonymous], 2000, Understanding Motion Capture for Computer Animation and Video Games
[6]  
[Anonymous], 2005, SINGULARITY IS NEAR
[7]  
Arkenbout E.A., 2014, DES MED DEVICES EUR
[8]  
Arsenault R., 2000, CHI 2000 Conference Proceedings. Conference on Human Factors in Computing Systems. CHI 2000. The Future is Here, P408, DOI 10.1145/332040.332466
[9]   Evaluation of the Leap Motion Controller as a New Contact-Free Pointing Device [J].
Bachmann, Daniel ;
Weichert, Frank ;
Rinkenauer, Gerhard .
SENSORS, 2015, 15 (01) :214-233
[10]  
Bent J, 2010, HUMAN FACTORS IN AVIATION, 2ND EDITION, P293, DOI 10.1016/B978-0-12-374518-7.00010-9