The Objective Assessment of Experts' and Novices' Suturing Skills Using An Image Analysis Program

被引:20
作者
Frischknecht, Adam C. [1 ]
Kasten, Steven J. [2 ]
Hamstra, Stanley J. [3 ]
Perkins, Noel C. [4 ]
Gillespie, R. Brent [4 ]
Armstrong, Thomas J. [5 ]
Minter, Rebecca M. [1 ,6 ]
机构
[1] Univ Michigan, Sch Med, Dept Surg, Ann Arbor, MI 48109 USA
[2] Univ Michigan, Sch Med, Sect Plast Surg, Ann Arbor, MI 48109 USA
[3] Univ Ottawa, Fac Med, Acad Innovat Med Educ, Ottawa, ON, Canada
[4] Univ Michigan, Dept Mech Engn, Ann Arbor, MI 48109 USA
[5] Univ Michigan, Dept Ind & Operat Engn, Ann Arbor, MI 48109 USA
[6] Univ Michigan, Sch Med, Dept Med Educ, Ann Arbor, MI 48109 USA
关键词
DELIBERATE PRACTICE; PERFORMANCE; ACQUISITION; EDUCATION; SURGEONS;
D O I
10.1097/ACM.0b013e31827c3411
中图分类号
G40 [教育学];
学科分类号
040101 ; 120403 ;
摘要
Purpose To objectively assess suturing performance using an image analysis program and to provide validity evidence for this assessment method by comparing experts' and novices' performance. Method In 2009, the authors used an image analysis program to extract objective variables from digital images of suturing end products obtained during a previous study involving third-year medical students (novices) and surgical faculty and residents (experts). Variables included number of stitches, stitch length, total bite size, travel, stitch orientation, total bite-size-to-travel ratio, and symmetry across the incision ratio. The authors compared all variables between groups to detect significant differences and two variables (total bite-size-to-travel ratio and symmetry across the incision ratio) to ideal values. Results Five experts and 15 novices participated. Experts' and novices' performances differed significantly (P < .05) with large effect sizes attributable to experience (Cohen d > 0.8) for total bite size (P = .009, d = 1.5), travel (P = .045, d = 1.1), total bite-size-to-travel ratio (P < .0001, d = 2.6), stitch orientation (P = .014, d = 1.4), and symmetry across the incision ratio (P = .022, d = 1.3). Conclusions The authors found that a simple computer algorithm can extract variables from digital images of a running suture and rapidly provide quantitative summative assessment feedback. The significant differences found between groups confirm that this system can discriminate between skill levels. This image analysis program represents a viable training tool for objectively assessing trainees' suturing, a foundational skill for many medical specialties.
引用
收藏
页码:260 / 264
页数:5
相关论文
共 18 条
[1]  
Accreditation Council for Graduate Medical Education, KEY CONS SEL ASS INS
[2]  
[Anonymous], OUTC PROJ
[3]   Viewpoint: Competency in surgical residency training: Defining and raising the bar [J].
Bhatti, Nasir I. ;
Cummings, Charles W. .
ACADEMIC MEDICINE, 2007, 82 (06) :569-573
[4]   Developing criteria for proficiency-based training of surgical technical skills using simulation:: Changes in performances as a function of training year [J].
Brydges, Ryan ;
Kurahashi, Allison ;
Bruemmer, Vera ;
Satterthwaite, Lisa ;
Classen, Roger ;
Dubrowski, Adam .
JOURNAL OF THE AMERICAN COLLEGE OF SURGEONS, 2008, 206 (02) :205-211
[5]   Shifting paradigms: From Flexner to competencies [J].
Carraccio, C ;
Wolfsthal, SD ;
Englander, R ;
Ferentz, K ;
Martin, C .
ACADEMIC MEDICINE, 2002, 77 (05) :361-367
[6]   No time to train the surgeons - More and more reforms result in less and less time for training [J].
Chikwe, J ;
de Souza, AC ;
Pepper, JR .
BMJ-BRITISH MEDICAL JOURNAL, 2004, 328 (7437) :418-419
[7]  
Cohen J., 1977, Statistical Power Analysis for the Behavioral Sciences
[8]   American Surgical Association Blue Ribbon Committee report on surgical education: 2004 [J].
Debas, HT ;
Bass, BL ;
Brennan, MF ;
Flynn, TC ;
Folse, JR ;
Freischlag, JA ;
Friedmann, P ;
Greenfield, LJ ;
Jones, RS ;
Lewis, FR ;
Malangoni, MA ;
Pellegrini, CA ;
Rose, EA ;
Sachdeva, AK ;
Sheldon, GF ;
Turner, PL ;
Warshaw, AL ;
Welling, RE ;
Zinner, MJ .
ANNALS OF SURGERY, 2005, 241 (01) :1-8
[9]   An expert-performance perspective of research on medical expertise: the study of clinical performance [J].
Ericsson, K. Anders .
MEDICAL EDUCATION, 2007, 41 (12) :1124-1130
[10]   Deliberate Practice and Acquisition of Expert Performance: A General Overview [J].
Ericsson, K. Anders .
ACADEMIC EMERGENCY MEDICINE, 2008, 15 (11) :988-994