Statistical modeling and recognition of surgical workflow

被引:176
作者
Padoy, Nicolas [1 ]
Blum, Tobias [2 ]
Ahmadi, Seyed-Ahmad [2 ]
Feussner, Hubertus [3 ]
Berger, Marie-Odile [4 ]
Navab, Nassir [2 ]
机构
[1] Johns Hopkins Univ, Engn Res Ctr Comp Integrated Surg Syst & Technol, Baltimore, MD 21218 USA
[2] Tech Univ Munich, D-8000 Munich, Germany
[3] Tech Univ Munich, Dept Surg, Klinikum Rechts Isar, D-8000 Munich, Germany
[4] LORIA INRIA Lorraine, Nancy, France
关键词
Surgical workflow; Context aware operating room; Surgical assistance system; Hidden Markov Model; Cholecystectomy; OPERATING-ROOM; ALGORITHM; SURGERY;
D O I
10.1016/j.media.2010.10.001
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we contribute to the development of context-aware operating rooms by introducing a novel approach to modeling and monitoring the workflow of surgical interventions. We first propose a new representation of interventions in terms of multidimensional time-series formed by synchronized signals acquired over time. We then introduce methods based on Dynamic Time Warping and Hidden Markov Models to analyze and process this data. This results in workflow models combining low-level signals with high-level information such as predefined phases, which can be used to detect actions and trigger an event. Two methods are presented to train these models, using either fully or partially labeled training surgeries. Results are given based on tool usage recordings from sixteen laparoscopic cholecystectomies performed by several surgeons. (C) 2010 Elsevier B.V. All rights reserved.
引用
收藏
页码:632 / 641
页数:10
相关论文
共 38 条
  • [1] A pervasive computing system for the operating room of the future
    Agarwal, Sheetal
    Joshi, Anupam
    Finin, Tim
    Yesha, Yelena
    Ganous, Tim
    [J]. MOBILE NETWORKS & APPLICATIONS, 2007, 12 (2-3) : 215 - 228
  • [2] Ahmadi SA, 2006, LECT NOTES COMPUT SC, V4190, P420
  • [3] The operating room of the future: what, when, and why?
    Berci, G
    Phillips, EH
    Fujita, F
    [J]. SURGICAL ENDOSCOPY AND OTHER INTERVENTIONAL TECHNIQUES, 2004, 18 (01): : 1 - 5
  • [4] Bhatia B., 2007, P C INN APP ART INT, V2, P1761
  • [5] Workflow mining for visualization and analysis of surgeries
    Blum, Tobias
    Padoy, Nicolas
    Feussner, Hubertus
    Navab, Nassir
    [J]. INTERNATIONAL JOURNAL OF COMPUTER ASSISTED RADIOLOGY AND SURGERY, 2008, 3 (05) : 379 - 386
  • [6] Blum T, 2008, LECT NOTES COMPUT SC, V5242, P627, DOI 10.1007/978-3-540-85990-1_75
  • [7] CLEARY K, 2005, LAPAROENDOSCOPIC ADV, V15, P495
  • [8] Auto identification technology and its impact on patient safety in the operating room of the future
    Egan, Marie T.
    Sandberg, Warren S.
    [J]. SURGICAL INNOVATION, 2007, 14 (01) : 41 - 50
  • [9] Feussner H, 2003, Semin Laparosc Surg, V10, P149, DOI 10.1177/107155170301000308
  • [10] FEUSSNER H, 1991, LANGENBECK ARCH CHIR, V376, P367