Surgical motion analysis using discriminative interpretable patterns

被引:46
作者
Forestier, Germain [1 ,2 ]
Petitjean, Francois [2 ]
Senin, Pavel [4 ]
Despinoy, Fabien [3 ]
Huaulme, Arnaud [3 ]
Fawaz, Hassan Ismail [1 ]
Weber, Jonathan [1 ]
Idoumghar, Lhassane [1 ]
Muller, Pierre-Alain [1 ]
Jannin, Pierre [3 ]
机构
[1] Univ Haute Alsace, IRIMAS, 12 Rue Freres Lumiere, F-68093 Mulhouse, France
[2] Monash Univ, Fac Informat Technol, Melbourne, Vic, Australia
[3] Univ Rennes, INSERM, LTSI, UMR S 1099, F-35000 Rennes, France
[4] Univ Hawaii Manoa, Los Alamos Natl Lab, Honolulu, HI 96822 USA
关键词
Temporal analysis; Dynamic time warping; Surgical process modelling; Surgery; OBJECTIVE STRUCTURED ASSESSMENT; SURGERY; SKILLS; TASK; CLASSIFICATION; RECOGNITION; COMPETENCE; NETWORKS; MODEL; OSATS;
D O I
10.1016/j.artmed.2018.08.002
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Objective: The analysis of surgical motion has received a growing interest with the development of devices allowing their automatic capture. In this context, the use of advanced surgical training systems makes an automated assessment of surgical trainee possible. Automatic and quantitative evaluation of surgical skills is a very important step in improving surgical patient care. Material and method: In this paper, we present an approach for the discovery and ranking of discriminative and interpretable patterns of surgical practice from recordings of surgical motions. A pattern is defined as a series of actions or events in the kinematic data that together are distinctive of a specific gesture or skill level. Our approach is based on the decomposition of continuous kinematic data into a set of overlapping gestures represented by strings (bag of words) for which we compute comparative numerical statistic (tf-idf) enabling the discriminative gesture discovery via its relative occurrence frequency. Results: We carried out experiments on three surgical motion datasets. The results show that the patterns identified by the proposed method can be used to accurately classify individual gestures, skill levels and surgical interfaces. We also present how the patterns provide a detailed feedback on the trainee skill assessment. Conclusions: The proposed approach is an interesting addition to existing learning tools for surgery as it provides a way to obtain a feedback on which parts of an exercise have been used to classify the attempt as correct or incorrect.
引用
收藏
页码:3 / 11
页数:9
相关论文
共 68 条
[1]  
Ahmidi N, 2017, IEEE T BIOMED ENG
[2]  
[Anonymous], 2016, P 25 INT JOINT C ART
[3]  
[Anonymous], 2008, INTRO INFORM RETRIEV, DOI DOI 10.1017/CBO9780511809071
[4]  
Bani MJ, 2017, ARXIV170709849
[5]   Surgeon specific mortality in. adult cardiac surgery: comparison between crude and risk stratified data [J].
Bridgewater, B ;
Grayson, AD ;
Jackson, M ;
Brooks, N ;
Grotte, GJ ;
Keenan, DJM ;
Millner, R ;
Fabri, BM ;
Jones, M .
BMJ-BRITISH MEDICAL JOURNAL, 2003, 327 (7405) :13-17
[6]  
Chaudhry R, 2009, TECHNICAL REPORT
[7]   What do master surgeons think of surgical competence and revalidation? [J].
Cuschieri, A ;
Francis, N ;
Crosby, J ;
Hanna, GB .
AMERICAN JOURNAL OF SURGERY, 2001, 182 (02) :110-116
[8]   Development of a model for training and evaluation of laparoscopic skills [J].
Derossis, AM ;
Fried, GM ;
Abrahamowicz, M ;
Sigman, HH ;
Barkun, JS ;
Meakins, JL .
AMERICAN JOURNAL OF SURGERY, 1998, 175 (06) :482-487
[9]   Unsupervised Trajectory Segmentation for Surgical Gesture Recognition in Robotic Training [J].
Despinoy, Fabien ;
Bouget, David ;
Forestier, Germain ;
Penet, Cedric ;
Zemiti, Nabil ;
Poignet, Philippe ;
Jannin, Pierre .
IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2016, 63 (06) :1280-1291
[10]  
Ding Li, 2017, ARXIV170507818