Development and prospective validation of a scoring system for the Basic Endoscopic Skills Training (BEST) box

被引:2
作者
Habaz, Ilay [1 ]
Perretta, Silvana [2 ]
Okrainec, Allan [1 ]
Svendrovski, Anton [3 ]
Guerriero, Ludovica [2 ]
Longo, Fabio [2 ]
Mascagni, Pietro [2 ]
Weiss, Ethan [1 ]
Liu, Louis W. C. [4 ]
Swanstrom, Lee L. [2 ,5 ]
Shlomovitz, Eran [1 ,2 ,6 ]
机构
[1] Univ Toronto, Univ Hlth Network, Div Gen Surg, Toronto Gen Hosp, PMB 1-298,585 Univ Ave, Toronto, ON M5G 2N2, Canada
[2] Inst Image Guided Surg IHU Strasbourg, Strasbourg, France
[3] UZIK Consulting Inc, Toronto, ON, Canada
[4] Univ Hlth Network, Div Gastroenterol, Toronto, ON, Canada
[5] Oregon Clin, Div GI MIS, Portland, OR USA
[6] Univ Hlth Network, Div Intervent Radiol, Toronto, ON, Canada
来源
SURGICAL ENDOSCOPY AND OTHER INTERVENTIONAL TECHNIQUES | 2021年 / 35卷 / 12期
关键词
Endoscopy simulator; Simulation; Scoring system; FES; FLS; FUNDAMENTALS;
D O I
10.1007/s00464-020-08152-9
中图分类号
R61 [外科手术学];
学科分类号
摘要
Aims The increased use of endoscopy as a minimally invasive therapeutic technique has created a great demand for endoscopic training. The Basic Endoscopic Skills Training (BEST) box provides a low-cost solution by adapting the Fundamentals of Laparoscopic Surgery (FLS) box for flexible endoscopic simulation. The BEST box consists of six endoscopic tasks with a 5-min time limit per task. This study aims to develop a scoring system for objective evaluation of user performance. Methods A total of 165 participants were tested on the BEST box. Participants were divided into two groups: retrospective analysis (n = 100) and prospective analysis (n = 65). From the retrospective group, 55 individuals were also scored on the Global Assessment of Gastrointestinal Endoscopic Skills-Upper Endoscopy (GAGES-UE). Linear regression between user performance on BEST box and GAGES-UE was performed to develop the scoring system. Receiver Operating Characteristic curve was used to determine a threshold score to help users appreciate their endoscopic expertise. Prospective scoring of 65 individuals was then performed using the formula developed (20 experts and 45 trainees). Results The minimum and maximum possible scores are 30 and 110, respectively. Retrospective analysis showed that the scoring system was able to distinguish between experts and trainees (p < 0.001), correlated with GAGES-UE (p < 0.001), and had a reliability constant of r = 0.765 (p < 0.001). On prospective testing using the scoring system the expert group received a final average score of 92, whereas the average score for the trainee group was 61 (p < 0.001). Conclusions The developed BEST box scoring system correlates with the experience level of the test taker as well as with the GAGES-UE scoring system. The results of this study add further evidence to the validity of the BEST box as an effective, low-cost endoscopic simulator with the scores used by trainees to track their performance level overtime.
引用
收藏
页码:6549 / 6555
页数:7
相关论文
共 11 条
[1]   Gathering Validity Evidence for Surgical Simulation A Systematic Review [J].
Borgersen, Nanna Jo ;
Naur, Therese M. H. ;
Sorensen, Stine M. D. ;
Bjerrum, Flemming ;
Konge, Lars ;
Subhi, Yousif ;
Thomsen, Ann Sofia S. .
ANNALS OF SURGERY, 2018, 267 (06) :1063-1068
[2]   Validation of educational assessments: a primer for simulation and beyond [J].
Cook D.A. ;
Hatala R. .
Advances in Simulation, 1 (1)
[3]   Feasibility of adapting the fundamentals of laparoscopic surgery trainer box to endoscopic skills training tool [J].
Crespin, Oscar M. ;
Okrainec, Allan ;
Kwong, Andrea V. ;
Habaz, Ilay ;
Jimenez, Maria Carolina ;
Szasz, Peter ;
Weiss, Ethan ;
Gonzalez, Cecilia G. ;
Mosko, Jeffrey D. ;
Liu, Louis W. C. ;
Swanstrom, Lee L. ;
Perretta, Silvana ;
Shlomovitz, Eran .
SURGICAL ENDOSCOPY AND OTHER INTERVENTIONAL TECHNIQUES, 2018, 32 (06) :2968-2983
[4]   Proficiency-based preparation significantly improves FES certification performance [J].
Guzzetta, Angela A. ;
Weis, Joshua J. ;
Hennessy, Sara A. ;
Willis, Ross E. ;
Wilcox, Victor, Jr. ;
Dunkin, Brian J. ;
Hogg, Deborah C. ;
Scott, Daniel J. .
SURGICAL ENDOSCOPY AND OTHER INTERVENTIONAL TECHNIQUES, 2018, 32 (11) :4451-4457
[5]   Adaptation of the fundamentals of laparoscopic surgery box for endoscopic simulation: performance evaluation of the first 100 participants [J].
Habaz, Ilay ;
Perretta, Silvana ;
Okrainec, Allan ;
Crespin, Oscar M. ;
Kwong, Andrea V. ;
Weiss, Ethan ;
van der Velden, Else ;
Guerriero, Ludovica ;
Longo, Fabio ;
Mascagni, Pietro ;
Liu, Louis W. C. ;
Jackson, Timothy D. ;
Swanstrom, Lee L. ;
Shlomovitz, Eran .
SURGICAL ENDOSCOPY AND OTHER INTERVENTIONAL TECHNIQUES, 2019, 33 (10) :3444-3450
[6]   On determining the most appropriate test cut-off value: the case of tests with continuous results [J].
Habibzadeh, Farrokh ;
Habibzadeh, Parham ;
Yadollahie, Mahboobeh .
BIOCHEMIA MEDICA, 2016, 26 (03) :297-307
[7]   Psychometric properties of the Fundamentals of Endoscopic Surgery (FES) skills examination [J].
Lineberry, Matthew ;
Ritter, E. Matthew .
SURGICAL ENDOSCOPY AND OTHER INTERVENTIONAL TECHNIQUES, 2017, 31 (12) :5219-5227
[8]   Simulation-based mastery learning for endoscopy using the endoscopy training system: a strategy to improve endoscopic skills and prepare for the fundamentals of endoscopic surgery (FES) manual skills exam [J].
Ritter, E. Matthew ;
Taylor, Zachary A. ;
Wolf, Kathryn R. ;
Franklin, Brenton R. ;
Placek, Sarah B. ;
Korndorffer, James R., Jr. ;
Gardner, Aimee K. .
SURGICAL ENDOSCOPY AND OTHER INTERVENTIONAL TECHNIQUES, 2018, 32 (01) :413-420
[9]   Performance indicators in colonoscopy after certification for independent practice: outcomes and predictors of competence [J].
Siau, Keith ;
Hodson, James ;
Valori, Roland M. ;
Ward, Stephen T. ;
Dunckley, Paul .
GASTROINTESTINAL ENDOSCOPY, 2019, 89 (03) :482-+
[10]   Fundamentals of endoscopic surgery: creation and validation of the hands-on test [J].
Vassiliou, Melina C. ;
Dunkin, Brian J. ;
Fried, Gerald M. ;
Mellinger, John D. ;
Trus, Thadeus ;
Kaneva, Pepa ;
Lyons, Calvin ;
Korndorffer, James R., Jr. ;
Ujiki, Michael ;
Velanovich, Vic ;
Kochman, Michael L. ;
Tsuda, Shawn ;
Martinez, Jose ;
Scott, Daniel J. ;
Korus, Gary ;
Park, Adrian ;
Marks, Jeffrey M. .
SURGICAL ENDOSCOPY AND OTHER INTERVENTIONAL TECHNIQUES, 2014, 28 (03) :704-711