Uncertainty-Aware Self-Supervised Learning for Cross-Domain Technical Skill Assessment in Robot-Assisted Surgery

被引:1
作者
Wang, Ziheng [1 ,2 ]
Mariani, Andrea [3 ,4 ]
Menciassi, Arianna [3 ,4 ]
De Momi, Elena [5 ]
Fey, Ann Majewicz [6 ,7 ]
机构
[1] Univ Texas Dallas, Dept Mech Engn, Richardson, TX 75080 USA
[2] Intuit Surg Inc, Peachtree Corners, GA 30092 USA
[3] Scuola Super Sant Anna, BioRobot Inst, I-56025 Pisa, Italy
[4] Scuola Super Sant Anna, Dept Excellence Robot & AI, I-56025 Pisa, Italy
[5] Politecn Milan, Dept Elect Informat & Bioengn, I-20133 Milan, Italy
[6] Univ Texas Austin, Dept Mech Engn, Austin, TX 78712 USA
[7] UT Southwestern Med Ctr, Dept Surg, Dallas, TX 75390 USA
来源
IEEE TRANSACTIONS ON MEDICAL ROBOTICS AND BIONICS | 2023年 / 5卷 / 02期
基金
美国国家科学基金会;
关键词
Training; Task analysis; Surgery; Kinematics; Data models; Robots; Uncertainty; Surgical skill assessment; surgical training; Bayesian deep learning; virtual reality; robot-assisted surgery; SURGICAL ROBOTICS; SIMULATORS; ACQUISITION; PERFORMANCE; VALIDATION;
D O I
10.1109/TMRB.2023.3272008
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Objective technical skill assessment is crucial for effective training of new surgeons in robot-assisted surgery. With advancements in surgical training programs in both physical and virtual environments, it is imperative to develop generalizable methods for automatically assessing skills. In this paper, we pro -pose a novel approach for skill assessment by transferring domain knowledge from labeled kinematic data to unlabeled data. Our approach leverages labeled data from common surgical training tasks such as Suturing, Needle Passing, and Knot Tying to jointly train a model with both labeled and unlabeled data. Pseudo labels are generated for the unlabeled data through an iterative man -ner that incorporates uncertainty estimation to ensure accurate labeling. We evaluate our method on a virtual reality simu-lated training task (Ring Transfer) using data from the da Vinci Research Kit (dVRK). The results show that trainees with robotic assistance have significantly higher expert probability compared to these without any assistance, p < 0.05, which aligns with previous studies showing the benefits of robotic assistance in improving training proficiency. Our method offers a significant advantage over other existing works as it does not require man-ual labeling or prior knowledge of the surgical training task for robot-assisted surgery.
引用
收藏
页码:301 / 311
页数:11
相关论文
共 51 条
[1]   Current status of validation for robotic surgery simulators a systematic review [J].
Abboudi, Hamid ;
Khan, Mohammed S. ;
Aboumarzouk, Omar ;
Guru, Khurshid A. ;
Challacombe, Ben ;
Dasgupta, Prokar ;
Ahmed, Kamran .
BJU INTERNATIONAL, 2013, 111 (02) :194-205
[2]   The role of non-technical skills in surgery [J].
Agha, Riaz A. ;
Fowler, Alexander J. ;
Sevdalis, Nick .
ANNALS OF MEDICINE AND SURGERY, 2015, 4 (04) :422-427
[3]   External validation of Global Evaluative Assessment of Robotic Skills (GEARS) [J].
Aghazadeh, Monty A. ;
Jayaratna, Isuru S. ;
Hung, Andrew J. ;
Pan, Michael M. ;
Desai, Mihir M. ;
Gill, Inderbir S. ;
Goh, Alvin C. .
SURGICAL ENDOSCOPY AND OTHER INTERVENTIONAL TECHNIQUES, 2015, 29 (11) :3261-3266
[4]   The role of surgical simulation and the learning curve in robot-assisted surgery [J].
Al Bareeq R. ;
Jayaraman S. ;
Kiaii B. ;
Schlachta C. ;
Denstedt J.D. ;
Pautler S.E. .
Journal of Robotic Surgery, 2008, 2 (1) :11-15
[5]   Virtual reality-assisted robotic surgery simulation [J].
Albani, Justin M. ;
Lee, David I. .
JOURNAL OF ENDOUROLOGY, 2007, 21 (03) :285-287
[6]   Medical Robots: Current Systems and Research Directions [J].
Beasley, Ryan A. .
JOURNAL OF ROBOTICS, 2012, 2012
[7]   Objective classification of residents based on their psychomotor laparoscopic skills [J].
Chmarra, Magdalena K. ;
Klein, Stefan ;
de Winter, Joost C. F. ;
Jansen, Frank-Willem ;
Dankelman, Jenny .
SURGICAL ENDOSCOPY AND OTHER INTERVENTIONAL TECHNIQUES, 2010, 24 (05) :1031-1039
[8]   Accelerating Surgical Robotics Research: A Review of 10 Years With the da Vinci Research Kit [J].
D'Ettorre, Claudia ;
Mariani, Andrea ;
Stilli, Agostino ;
Baena, Ferdinando Rodriguez Y. ;
Valdastri, Pietro ;
Deguet, Anton ;
Kazanzides, Peter ;
Taylor, Russell H. ;
Fischer, Gregory S. ;
DiMaio, Simon P. ;
Menciassi, Arianna ;
Stoyanov, Danail .
IEEE ROBOTICS & AUTOMATION MAGAZINE, 2021, 28 (04) :56-78
[9]   Assessing operative skill - Needs to become more objective [J].
Darzi, A ;
Smith, S ;
Taffinder, N .
BRITISH MEDICAL JOURNAL, 1999, 318 (7188) :887-888
[10]  
Enayati N, 2018, IEEE INT CONF ROBOT, P6631, DOI 10.1109/ICRA.2018.8463168