Developing an Objective Structured Assessment of Technical Skills for Laparoscopic Suturing and Intracorporeal Knot Tying

被引:54
作者
Chang, Olivia H. [1 ,2 ]
King, Louise P. [1 ,2 ]
Modest, Anna M. [1 ]
Hur, Hye-Chun [1 ,2 ]
机构
[1] Beth Israel Deaconess Med Ctr, Dept Obstet & Gynecol, Boston, MA 02215 USA
[2] Harvard Univ, Sch Med, Dept Obstet Gynecol & Reprod Biol, Boston, MA 02115 USA
关键词
Objective Structured Assessment of Technical Skills (OSATS); intracorporeal knot tying; laparoscopic suturing; surgical education; OSATS; SIMULATION; RESIDENTS;
D O I
10.1016/j.jsurg.2015.10.006
中图分类号
G40 [教育学];
学科分类号
040101 ; 120403 ;
摘要
OBJECTIVE: To develop a teaching and assessment tool for laparoscopic suturing and intracorporeal knot tying. DESIGN AND SETTING: We designed an Objective Structured Assessment of Technical Skills (OSATS) tool that includes a procedure-specific checklist (PSC) and global rating scale (GRS) to assess laparoscopic suturing and intracorporeal knot-tying performance. Obstetrics and Gynecology residents at our institution were videotaped while performing a laparoscopic suturing and intracorporeal knot-tying task at a surgical simulation workshop. A total of 2 expert reviewers assessed resident performance using the OSATS tool during live performance and 1 month later using the videotaped recordings. OSATS scores were analyzed using the Wilcoxon rank-sum test. Data are presented as median scores (interquartile range [IQR]). Intrarater and interrater reliabilities were assessed using a Spearman correlation and are presented as an r correlation coefficient and p value. An r >= 0.8 was considered as a high correlation. After testing, we received feedback from residents and faculty to improve the OSATS tool as part of an iterative design process. PARTICIPANTS: In all, 14 of 21 residents (66.7%) completed the study, with 9 junior residents and 5 senior residents. RESULTS: Junior residents had a lower score on the PSC than senior residents did; however, this was not statistically significant (median = 6.0 [IQR: 4.0-10.0] and median = 13.0 [IQR: 10.0-13.0]; p = 0.09). There was excellent intrarater reliability with our OSATS tool (for PSC component, r = 0.88 for Rater 1 and 0.93 for Rater 2, both p < 0.0001; for GRS component, r = 0.85 for Rater 1 and 0.88 for Rater 2, both p < 0.0002). The PSC also has high interrater reliability during live evaluation (r = 0.92; p < 0.0001), and during the videotape scoring with r= 0.77 (p = 0.001). CONCLUSIONS: Our OSATS tool may be a useful assessment and teaching tool for laparoscopic suturing and intracorporeal knot-tying skills. Overall, good intrarater reliability was demonstrated, suggesting that this tool may be useful for longitudinal assessment of surgical skills. (C) 2015 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.
引用
收藏
页码:258 / 263
页数:6
相关论文
共 17 条
[1]   Observational tools for assessment of procedural skills: a systematic review [J].
Ahmed, Kamran ;
Miskovic, Danilo ;
Darzi, Ara ;
Athanasiou, Thanos ;
Hanna, George B. .
AMERICAN JOURNAL OF SURGERY, 2011, 202 (04) :469-U161
[2]   Objective Structured Assessment of Technical Skills in Elliptical Excision Repair of Senior Dermatology Residents A Multirater, Blinded Study of Operating Room Video Recordings [J].
Alam, Murad ;
Nodzenski, Michael ;
Yoo, Simon ;
Poon, Emily ;
Bolotin, Diana .
JAMA DERMATOLOGY, 2014, 150 (06) :608-612
[3]   An update and review of simulation in urological training [J].
Brewin, James ;
Ahmed, Kamran ;
Challacombe, Ben .
INTERNATIONAL JOURNAL OF SURGERY, 2014, 12 (02) :103-108
[4]   Relationship between skill and outcome in the laboratory-based model [J].
Datta, V ;
Mandalia, M ;
Mackay, S ;
Chang, A ;
Cheshire, N ;
Darzi, A .
SURGERY, 2002, 131 (03) :318-323
[5]   Development of an objective structured assessment of technical skills for obstetric and gynecology residents [J].
Goff, BA ;
Lentz, GM ;
Lee, D ;
Houmard, B ;
Mandel, LS .
OBSTETRICS AND GYNECOLOGY, 2000, 96 (01) :146-150
[6]   Development of a bench station objective structured assessment of technical skills [J].
Goff, BA ;
Lentz, GM ;
Lee, D ;
Fenner, D ;
Morris, J ;
Mandel, LS .
OBSTETRICS AND GYNECOLOGY, 2001, 98 (03) :412-416
[7]   Research electronic data capture (REDCap)-A metadata-driven methodology and workflow process for providing translational research informatics support [J].
Harris, Paul A. ;
Taylor, Robert ;
Thielke, Robert ;
Payne, Jonathon ;
Gonzalez, Nathaniel ;
Conde, Jose G. .
JOURNAL OF BIOMEDICAL INFORMATICS, 2009, 42 (02) :377-381
[8]   Assessment of Validity of an OSATS for Cystoscopic and Ureteroscopic Cognitive and Psychomotor Skills [J].
Kishore, Thekke Adiyat ;
Pedro, Renato N. ;
Monga, Manoj ;
Sweet, Robert M. .
JOURNAL OF ENDOUROLOGY, 2008, 22 (12) :2707-2711
[9]  
Martin JA, 1997, BRIT J SURG, V84, P273, DOI 10.1002/bjs.1800840237
[10]   Testing technical skill via an innovative ''bench station'' examination [J].
Reznick, R ;
Regehr, G ;
MacRae, H ;
Martin, J ;
McCulloch, W .
AMERICAN JOURNAL OF SURGERY, 1997, 173 (03) :226-230