Development and validation of the TOCO-TURBT tool: a summative assessment tool that measures surgical competency in transurethral resection of bladder tumour

被引：14

作者：

de Vries, Anna H. ^{[1
]}

Muijtjens, Arno. M. M. ^{[2
]}

van Genugten, Hilde G. J. ^{[1
]}

Hendrikx, Ad. J. M. ^{[1
]}

Koldewijn, Evert L. ^{[1
,3
]}

Schout, Barbara M. A. ^{[4
,5
]}

van der Vleuten, Cees P. M. ^{[2
]}

Wagner, Cordula ^{[5
,6
]}

Tjiam, Irene M. ^{[7
]}

van Merrienboer, Jeroen J. G. ^{[3
]}

机构：

[1] Catharina Hosp, Dept Urol, Michelangelolaan 2, NL-5623 EJ Eindhoven, Netherlands

[2] Maastricht Univ, Fac Hlth Med & Life Sci, Dept Educ Dev & Res, Maastricht, Netherlands

[3] Maastricht Univ, Sch Hlth Profess Educ, Maastricht, Netherlands

[4] Alrijne Hosp, Dept Urol, Leiden, Netherlands

[5] Netherlands Inst Hlth Serv Res NIVEL, Utrecht, Netherlands

[6] EMGO Inst Hlth & Care Res, Dept Publ & Occupat Hlth, Amsterdam, Netherlands

[7] Canisius Wilhelmina Hosp, Dept Urol, Nijmegen, Netherlands

来源：

SURGICAL ENDOSCOPY AND OTHER INTERVENTIONAL TECHNIQUES | 2018年 / 32卷 / 12期

关键词：

Assessment; Cognitive task analysis; Certification; Transurethral resection of bladder tumour; Urology; Validation; OPERATIVE PERFORMANCE; TECHNICAL PERFORMANCE; OBJECTIVE ASSESSMENT; PROCEDURAL SKILLS; RELIABILITY; PROGRAM; VALIDITY; SURGERY; FEASIBILITY; RECURRENCE;

D O I：

10.1007/s00464-018-6251-8

中图分类号：

R61 [外科手术学];

学科分类号：

摘要：

BackgroundThe current shift towards competency-based residency training has increased the need for objective assessment of skills. In this study, we developed and validated an assessment tool that measures technical and non-technical competency in transurethral resection of bladder tumour (TURBT).MethodsThe Test Objective Competency' (TOCO)-TURBT tool was designed by means of cognitive task analysis (CTA), which included expert consensus. The tool consists of 51 items, divided into 3 phases: preparatory (n=15), procedural (n=21), and completion (n=15). For validation of the TOCO-TURBT tool, 2 TURBT procedures were performed and videotaped by 25 urologists and 51 residents in a simulated setting. The participants' degree of competence was assessed by a panel of eight independent expert urologists using the TOCO-TURBT tool. Each procedure was assessed by two raters. Feasibility, acceptability and content validity were evaluated by means of a quantitative cross-sectional survey. Regression analyses were performed to assess the strength of the relation between experience and test scores (construct validity). Reliability was analysed by generalizability theory.ResultsThe majority of assessors and urologists indicated the TOCO-TURBT tool to be a valid assessment of competency and would support the implementation of the TOCO-TURBT assessment as a certification method for residents. Construct validity was clearly established for all outcome measures of the procedural phase (all r>0.5, p<0.01). Generalizability-theory analysis showed high reliability (coefficient Phi0.8) when using the format of two assessors and two cases.ConclusionsThis study provides first evidence that the TOCO-TURBT tool is a feasible, valid and reliable assessment tool for measuring competency in TURBT. The tool has the potential to be used for future certification of competencies for residents and urologists. The methodology of CTA might be valuable in the development of assessment tools in other areas of clinical practice.

引用

页码：4923 / 4931

页数：9

共 31 条

[1] Toward feasible, valid, and reliable video-based assessments of technical surgical skills in the operating room [J].

Aggarwal, Rajesh ;

Grantcharov, Teodor ;

Moorthy, Krishna ;

Milland, Thor ;

Darzi, Ara .

ANNALS OF SURGERY, 2008, 247 (02) :372-379

[2] The Effect of Resident Involvement on Perioperative Outcomes in Transurethral Urologic Surgeries [J].

Allard, Christopher B. ;

Meyer, Christian P. ;

Gandaglia, Giorgio ;

Chang, Steven L. ;

Chun, Felix K. H. ;

Gelpi-Hammerschmidt, Francisco ;

Hanske, Julian ;

Kibel, Adam S. ;

Preston, Mark A. ;

Quoc-Dien Trinh .

JOURNAL OF SURGICAL EDUCATION, 2015, 72 (05) :1018-1025

[3] EAU Guidelines on Non-Muscle-invasive Urothelial Carcinoma of the Bladder: Update 2013 [J].

Babjuk, Marko ;

Burger, Maximilian ;

Zigeuner, Richard ;

Shariat, Shahrokh F. ;

van Rhijn, Bas W. G. ;

Comperat, Eva ;

Sylvester, Richard J. ;

Kaasinen, Eero ;

Boehle, Andreas ;

Palou Redorta, Joan ;

Roupret, Morgan .

EUROPEAN UROLOGY, 2013, 64 (04) :639-653

[4] The Canadian Adverse Events Study:: the incidence of adverse events among hospital patients in Canada [J].

Baker, GR ;

Norton, PG ;

Flintoft, V ;

Blais, R ;

Brown, A ;

Cox, J ;

Etchells, E ;

Ghali, WA ;

Hébert, P ;

Majumdar, SR ;

O'Beirne, M ;

Palacios-Derflingher, L ;

Reid, RJ ;

Sheps, S ;

Tamblyn, R .

CANADIAN MEDICAL ASSOCIATION JOURNAL, 2004, 170 (11) :1678-1686

[5] The validity and reliability of a Direct Observation of Procedural Skills assessment tool: assessing colonoscopic skills of senior endoscopists [J].

Barton, John Roger ;

Corbett, Sally ;

van der Vleuten, Cees Petronella .

GASTROINTESTINAL ENDOSCOPY, 2012, 75 (03) :591-597

[6] Variability in the recurrence rate at first follow-up cystoscopy after TUR in stage Ta T1 transitional cell carcinoma of the bladder: A combined analysis of seven EORTC studies [J].

Brausi, M ;

Collette, L ;

Kurth, K ;

van der Meijden, AP ;

Oosterlinck, W ;

Witjes, JA ;

Newling, D ;

Bouffioux, C ;

Sylvester, RJ .

EUROPEAN UROLOGY, 2002, 41 (05) :523-530

[7]

Clark R., 2008, COGNITIVE TASK ANAL, P577

[8]

Cohen J., 1988, STAT POWER ANAL BEHA, DOI [10.4324/9780203771587, DOI 10.4324/9780203771587]

[9] Generalisability: a key to unlock professional assessment [J].

Crossley, J ;

Davies, H ;

Humphris, G ;

Jolly, B .

MEDICAL EDUCATION, 2002, 36 (10) :972-978

[10] Setting pass scores for assessment of technical performance by surgical trainees [J].

de Montbrun, S. ;

Satterthwaite, L. ;

Grantcharov, T. P. .

BRITISH JOURNAL OF SURGERY, 2016, 103 (03) :300-306

← 1 2 3 4 →