Artificial Intelligence for Surgical Safety Automatic Assessment of the Critical View of Safety in Laparoscopic Cholecystectomy Using Deep Learning

被引:168
作者
Mascagni, Pietro [1 ,2 ]
Vardazaryan, Armine [1 ]
Alapatt, Deepak [1 ]
Urade, Takeshi [3 ]
Emre, Taha [1 ]
Fiorillo, Claudio [2 ]
Pessaux, Patrick [3 ,4 ,5 ]
Mutter, Didier [4 ,5 ]
Marescaux, Jacques [4 ]
Costamagna, Guido [2 ]
Dallemagne, Bernard [4 ,5 ]
Padoy, Nicolas [1 ]
机构
[1] Univ Strasbourg, CNRS, ICube, IHU Strasbourg, Strasbourg, France
[2] Fdn Policlin Univ A Gemelli IRCCS, Rome, Italy
[3] IHU Strasbourg, Inst Image Guided Surg, Strasbourg, France
[4] Inst Res Digest Canc IRCAD, Strasbourg, France
[5] Univ Strasbourg, Dept Digest & Endocrine Surg, Strasbourg, France
关键词
anatomical segmentation; artificial intelligence; computer vision; critical view of safety; deep learning; laparoscopic cholecystectomy; surgical data science; surgical safety; INTRAOPERATIVE ADVERSE EVENTS; GENERATION; INJURY;
D O I
10.1097/SLA.0000000000004351
中图分类号
R61 [外科手术学];
学科分类号
摘要
Objective: To develop a deep learning model to automatically segment hepatocystic anatomy and assess the criteria defining the critical view of safety (CVS) in laparoscopic cholecystectomy (LC). Background: Poor implementation and subjective interpretation of CVS contributes to the stable rates of bile duct injuries in LC. As CVS is assessed visually, this task can be automated by using computer vision, an area of artificial intelligence aimed at interpreting images. Methods: Still images from LC videos were annotated with CVS criteria and hepatocystic anatomy segmentation. A deep neural network comprising a segmentation model to highlight hepatocystic anatomy and a classification model to predict CVS criteria achievement was trained and tested using 5-fold cross validation. Intersection over union, average precision, and balanced accuracy were computed to evaluate the model performance versus the annotated ground truth. Results: A total of 2854 images from 201 LC videos were annotated and 402 images were further segmented. Mean intersection over union for segmentation was 66.6%. The model assessed the achievement of CVS criteria with a mean average precision and balanced accuracy of 71.9% and 71.4%, respectively. Conclusions: Deep learning algorithms can be trained to reliably segment hepatocystic anatomy and assess CVS criteria in still laparoscopic images. Surgical-technical partnerships should be encouraged to develop and evaluate deep learning models to improve surgical safety.
引用
收藏
页码:955 / 961
页数:7
相关论文
共 40 条
[1]   System Factors Affecting Patient Safety in the OR An Analysis of Safety Threats and Resiliency [J].
Adams-McGavin, Robert Chris ;
Jung, James J. ;
van Dalen, Anne S. H. M. ;
Grantcharov, Teodor P. ;
Schijven, Marlies P. .
ANNALS OF SURGERY, 2021, 274 (01) :114-119
[2]   15 Years of Litigation Following Laparoscopic Cholecystectomy in England [J].
Alkhaffaf, Bilal ;
Decadt, Bart .
ANNALS OF SURGERY, 2010, 251 (04) :682-685
[3]   Laparoscopic cholecystectomy: first, do no harm; second, take care of bile duct stones [J].
Berci, George ;
Hunter, John ;
Morgenstern, Leon ;
Arregui, Maurice ;
Brunt, Michael ;
Carroll, Brandon ;
Edye, Michael ;
Fermelia, David ;
Ferzli, George ;
Greene, Frederick ;
Petelin, Joseph ;
Phillips, Edward ;
Ponsky, Jeffrey ;
Sax, Harry ;
Schwaitzberg, Steven ;
Soper, Nathaniel ;
Swanstrom, Lee ;
Traverso, William .
SURGICAL ENDOSCOPY AND OTHER INTERVENTIONAL TECHNIQUES, 2013, 27 (04) :1051-1054
[4]   Intraoperative Adverse Events in Abdominal Surgery What Happens in the Operating Room Does Not Stay in the Operating Room [J].
Bohnen, Jordan D. ;
Mavros, Michael N. ;
Ramly, Elie P. ;
Chang, Yuchiao ;
Yeh, D. Dante ;
Lee, Jarone ;
De Moya, Marc ;
King, David R. ;
Fagenholz, Peter J. ;
Butler, Kathryn ;
Velmahos, George C. ;
Kaafarani, Haytham M. A. .
ANNALS OF SURGERY, 2017, 265 (06) :1119-1125
[5]  
Breheret A., 2017, Pixel annotation tool
[6]   Increasing resident utilization and recognition of the critical view of safety during laparoscopic cholecystectomy: a pilot study from an academic medical center [J].
Chen, Crystal B. ;
Palazzo, Francesco ;
Doane, Stephen M. ;
Winter, Jordan M. ;
Lavu, Harish ;
Chojnacki, Karen A. ;
Rosato, Ernest L. ;
Yeo, Charles J. ;
Pucci, Michael J. .
SURGICAL ENDOSCOPY AND OTHER INTERVENTIONAL TECHNIQUES, 2017, 31 (04) :1627-1635
[7]   Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation [J].
Chen, Liang-Chieh ;
Zhu, Yukun ;
Papandreou, George ;
Schroff, Florian ;
Adam, Hartwig .
COMPUTER VISION - ECCV 2018, PT VII, 2018, 11211 :833-851
[8]   IRCAD recommendation on safe laparoscopic cholecystectomy [J].
Conrad, Claudius ;
Wakabayashi, Go ;
Asbun, Horacio J. ;
Dallemagne, Bernard ;
Demartines, Nicolas ;
Diana, Michele ;
Fuks, David ;
Gimenez, Mariano Eduardo ;
Goumard, Claire ;
Kaneko, Hironori ;
Memeo, Riccardo ;
Resende, Alexandre ;
Scatton, Olivier ;
Schneck, Anne-Sophie ;
Soubrane, Olivier ;
Tanabe, Minoru ;
van den Bos, Jacqueline ;
Weiss, Helmut ;
Yamamoto, Masakazu ;
Marescaux, Jacques ;
Pessaux, Patrick .
JOURNAL OF HEPATO-BILIARY-PANCREATIC SCIENCES, 2017, 24 (11) :603-615
[9]  
Deng J, 2009, PROC CVPR IEEE, P248, DOI 10.1109/CVPRW.2009.5206848
[10]   Registering the critical view of safety: photo or video? [J].
Emous, M. ;
Westerterp, M. ;
Wind, J. ;
Eerenberg, J. P. ;
van Geloven, A. A. W. .
SURGICAL ENDOSCOPY AND OTHER INTERVENTIONAL TECHNIQUES, 2010, 24 (10) :2527-2530