Context-based hand gesture recognition for the operating room

被引:52
作者
Jacob, Mithun George [1 ]
Wachs, Juan Pablo [1 ]
机构
[1] Purdue Univ, Sch Ind Engn, W Lafayette, IN 47906 USA
基金
美国医疗保健研究与质量局;
关键词
Continuous gesture recognition; Operating room; Human computer interaction;
D O I
10.1016/j.patrec.2013.05.024
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
A sterile, intuitive context-integrated system for navigating MRIs through freehand gestures during a neurobiopsy procedure is presented. Contextual cues are used to determine the intent of the user to improve continuous gesture recognition, and the discovery and exploration of MRIs. One of the challenges in gesture interaction in the operating room is to discriminate between intentional and non-intentional gestures. This problem is also referred as spotting. In this paper, a novel method for training gesture spotting networks is presented. The continuous gesture recognition system was shown to successfully detect gestures 92.26% of the time with a reliability of 89.97%. Experimental results show that significant improvements in task completion time were obtained through the effect of context integration. (C) 2013 Elsevier B.V. All rights reserved.
引用
收藏
页码:196 / 203
页数:8
相关论文
共 45 条
[1]  
Albu AB, 2006, LECT NOTES COMPUT SC, V4291, P771
[2]  
[Anonymous], 2000, Opencv. Dr. Dobb's journal of software tools
[3]  
Ansotegui C., 2007, LOGIC WEIGHTED CSP
[4]   A sensor fusion approach for recognizing continuous human grasping sequences using hidden Markov models [J].
Bernardin, K ;
Ogawara, K ;
Ikeuchi, K ;
Dillmann, R .
IEEE TRANSACTIONS ON ROBOTICS, 2005, 21 (01) :47-57
[5]  
Boochever S.S, 2004, RADIOL MANAGE, V26, P25
[6]  
Boochever Stephen S, 2004, Radiol Manage, V26, P16
[7]  
Ebert L.C., 2011, SURG INNOVATION
[8]   HAND TRAJECTORY-BASED GESTURE SPOTTING AND RECOGNITION USING HMM [J].
Elmezain, Mahmoud ;
Al-Hamadi, Ayoub ;
Michaelis, Bernd .
2009 16TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOLS 1-6, 2009, :3577-3580
[9]   The eyes have it: the neuroethology, function and evolution of social gaze [J].
Emery, NJ .
NEUROSCIENCE AND BIOBEHAVIORAL REVIEWS, 2000, 24 (06) :581-604
[10]   Why communication fails in the operating room [J].
Firth-Cozens, J .
QUALITY & SAFETY IN HEALTH CARE, 2004, 13 (05) :327-327