Validity evidence for endoscopic ultrasound competency assessment tools: Systematic review

被引:0
作者
Ceccacci, Alessandra [1 ]
Hothi, Harneet [2 ]
Khan, Rishad [3 ]
Gimpaya, Nikko [4 ]
Chan, Brian P. H. [1 ,3 ,5 ]
Forbes, Nauzer [6 ]
James, Paul [1 ,3 ,7 ]
Low, Daniel Jeffry [1 ,3 ,5 ]
Mosko, Jeffrey [1 ,3 ,8 ,9 ]
Yeung, Elaine T. [1 ,3 ,5 ]
Walsh, Catharine M. [10 ,11 ,12 ,13 ]
Grover, Samir C. [1 ,3 ,4 ,5 ]
机构
[1] Univ Toronto, Dept Med, Toronto, ON, Canada
[2] Univ Toronto, Temerty Fac Med, Toronto, ON, Canada
[3] Univ Toronto, Div Gastroenterol & Hepatol, Toronto, ON, Canada
[4] Scarborough Hlth Network, Scarborough Hlth Network Res Inst, Scarborough, ON, Canada
[5] Scarborough Hlth Network, Div Gastroenterol, Scarborough, ON, Canada
[6] Univ Calgary, Div Gastroenterol & Hepatol, Calgary, AB, Canada
[7] Univ Hlth Network, Div Gastroenterol, Toronto, ON, Canada
[8] St Michaels Hosp, Div Gastroenterol, Toronto, ON, Canada
[9] Li Ka Shing Knowledge Inst, Unity Hlth Toronto, Toronto, ON, Canada
[10] Hosp Sick Children, Dept Paediat, Div Gastroenterol Hepatol & Nutr, Toronto, ON, Canada
[11] Hosp Sick Children, Res & Learning Inst, Toronto, ON, Canada
[12] Univ Toronto, Temerty Fac Med, Dept Pediat, Toronto, ON, Canada
[13] Univ Toronto, Wilson Ctr, Temerty Fac Med, Toronto, ON, Canada
关键词
Endoscopic ultrasonography; Quality and logistical aspects; Training; Performance and complications; MEDICAL-EDUCATION; TECHNICAL SKILLS; LEARNING-CURVES; EUS; ULTRASONOGRAPHY; PERFORMANCE; VALIDATION; TRAINEES; QUALITY;
D O I
10.1055/a-2465-7283
中图分类号
R57 [消化系及腹部疾病];
学科分类号
摘要
Background and study aims Competent endoscopic ultrasound (EUS) performance requires a combination of technical, cognitive, and non-technical skills. Direct observation assessment tools can be employed to enhance learning and ascertain clinical competence; however, there is a need to systematically evaluate validity evidence supporting their use. We aimed to evaluate the validity evidence of competency assessment tools for EUS and examine their educational utility. Methods We systematically searched five databases and gray literature for studies investigating EUS competency assessment tools from inception to May 2023. Data on validity evidence across five domains (content, response process, internal structure, relations to other variables, and consequences) were extracted and graded (maximum score 15). We evaluated educational utility using the Accreditation Council for Graduate Medical Education framework and methodological quality using the Medical Education Research Quality Instrument (MERSQI). Results From 2081 records, we identified five EUS assessment tools from 10 studies. All tools are formative assessments intended to guide learning, with four employed in clinical settings. Validity evidence scores ranged from 3 to 12. The EUS and ERCP Skills Assessment Tool (TEESAT), Global Assessment of Performance and Skills in EUS (GAPS-EUS), and the EUS Assessment Tool (EUSAT) had the strongest validity evidence with scores of 12, 10, and 10, respectively. Overall educational utility was high given ease of tool use. MERSQI scores ranged from 9.5 to 12 (maximum score 13.5). Conclusions The TEESAT, GAPS-EUS, and EUSAT demonstrate strong validity evidence for formative assessment of EUS and are easily implemented in educational settings to monitor progress and support learning.
引用
收藏
页码:E1465 / E1475
页数:11
相关论文
共 31 条
[11]   GAPS-EUS: a new and reliable too or the assessment of basic skills and performance in EUS among endosonography trainees [J].
Hedenstrom, Per ;
Marasco, Giovanni ;
Eusebi, Leonardo Henry ;
Lindkvist, Bjorn ;
Sadik, Riadh .
BMJ OPEN GASTROENTEROLOGY, 2021, 8 (01)
[12]   Curriculum for ERCP and endoscopic ultrasound training in Europe: European Society of Gastrointestinal Endoscopy (ESGE) Position Statement [J].
Johnson, Gavin ;
Webster, George ;
Boskoski, Ivo ;
Campos, Sara ;
Goelder, Stefan Karl ;
Schlag, Christoph ;
Anderloni, Andrea ;
Arnelo, Urban ;
Badaoui, Abdenor ;
Bekkali, Noor ;
Christodoulou, Dimitrios ;
Czako, Laszlo ;
Viesca, Michael Fernandez Y. ;
Hritz, Istvan ;
Hucl, Tomas ;
Kalaitzakis, Evangelos ;
Kylanpaa, Leena ;
Nedoluzhko, Ivan ;
Petrone, Maria Chiara ;
Poley, Jan-Werner ;
Seicean, Andrada ;
Vila, Juan ;
Arvanitakis, Marianna ;
Dinis-Ribeiro, Mario ;
Ponchon, Thierry ;
Bisschops, Raf .
ENDOSCOPY, 2021, 53 (10) :1071-1087
[13]   A core curriculum for basic EUS skills: An international consensus using the Delphi methodology [J].
Karstensen, John ;
Nayahangan, Leizl ;
Konge, Lars ;
Vilmann, Peter ;
The Eus Delphi Panel .
ENDOSCOPIC ULTRASOUND, 2022, 11 (02) :122-+
[14]   Validity evidence for observational ERCP competency assessment tools: a systematic review [J].
Khan, Rishad ;
Homsi, Hoomam ;
Gimpaya, Nikko ;
Lisondra, James ;
Sabrie, Nasruddin ;
Gholami, Reza ;
Bansal, Rishi ;
Scaffidi, Michael A. ;
Lightfoot, David ;
James, Paul D. ;
Siau, Keith ;
Forbes, Nauzer ;
Wani, Sachin ;
Keswani, Rajesh N. ;
Walsh, Catharine M. ;
Grover, Samir C. .
ENDOSCOPY, 2023, 55 (09) :847-856
[15]   Colonoscopy competence assessment tools: a systematic review of validity evidence [J].
Khan, Rishad ;
Zheng, Eric ;
Wani, Sachin B. ;
Scaffidi, Michael A. ;
Jeyalingam, Thurarshen ;
Gimpaya, Nikko ;
Anderson, John T. ;
Grover, Samir C. ;
McCreath, Graham ;
Walsh, Catharine M. .
ENDOSCOPY, 2021, 53 (12) :1235-1245
[16]   Reliable and valid assessment of competence in endoscopic ultrasonography and fine-needle aspiration for mediastinal staging of non-small cell lung cancer [J].
Konge, L. ;
Vilmann, P. ;
Clementsen, P. ;
Annema, J. T. ;
Ringsted, C. .
ENDOSCOPY, 2012, 44 (10) :928-933
[17]   Endoscopic ultrasound fine needle aspiration vs fine needle biopsy for pancreatic masses, subepithelial lesions, and lymph nodes [J].
Levine, Irving ;
Trindade, Arvind J. .
WORLD JOURNAL OF GASTROENTEROLOGY, 2021, 27 (26) :4194-4207
[18]   Training in radial EUS: What is the best approach and is there a role for the nurse endoscopist? [J].
Meenan, J ;
Anderson, S ;
Tsang, S ;
Reffitt, D ;
Prasad, P ;
Doig, L .
ENDOSCOPY, 2003, 35 (12) :1020-1023
[19]   VALIDITY OF PSYCHOLOGICAL-ASSESSMENT - VALIDATION OF INFERENCES FROM PERSONS RESPONSES AND PERFORMANCES AS SCIENTIFIC INQUIRY INTO SCORE MEANING [J].
MESSICK, S .
AMERICAN PSYCHOLOGIST, 1995, 50 (09) :741-749
[20]   Status of Competency-Based Medical Education in Endoscopy Training: A Nationwide Survey of US ACGME-Accredited Gastroenterology Training Programs [J].
Patel, S. G. ;
Keswani, R. ;
Elta, G. ;
Saini, S. ;
Menard-Katcher, P. ;
Del Valle, J. ;
Hosford, L. ;
Myers, A. ;
Ahnen, D. ;
Schoenfeld, P. ;
Wani, S. .
AMERICAN JOURNAL OF GASTROENTEROLOGY, 2015, 110 (07) :956-962