The Bristol Radiology Report Assessment Tool (BRRAT): Developing a workplace-based assessment tool for radiology reporting skills

被引:11
作者
Wallis, A. [1 ]
Edey, A. [2 ]
Prothero, D. [3 ]
McCoubrie, P. [2 ]
机构
[1] Queen Alexandra Hosp, Dept Radiol, Portsmouth, Hants, England
[2] Southmead Hosp, Dept Radiol, Bristol, Avon, England
[3] IM&T Consortium, Bristol, Avon, England
关键词
SHEFFIELD ASSESSMENT INSTRUMENT; CONSTRUCT ALIGNMENT; PERFORMANCE; QUALITY; SAIL;
D O I
10.1016/j.crad.2013.06.019
中图分类号
R8 [特种医学]; R445 [影像诊断学];
学科分类号
1002 ; 100207 ; 1009 ;
摘要
AIM: To review the development of a workplace-based assessment tool to assess the quality of written radiology reports and assess its reliability, feasibility, and validity. MATERIALS AND METHODS: A comprehensive literature review and rigorous Delphi study enabled the development of the Bristol Radiology Report Assessment Tool (BRRAT), which consists of 19 questions and a global assessment score. Three assessors applied the assessment tool to 240 radiology reports provided by 24 radiology trainees. RESULTS: The reliability coefficient for the 19 questions was 0.79 and the equivalent coefficient for the global assessment scores was 0.67. Generalizability coefficients demonstrate that higher numbers of assessors and assessments are needed to reach acceptable levels of reliability for summative assessments due to assessor subjectivity. CONCLUSION: The study methodology gives good validity and strong foundation in best-practice. The assessment tool developed for radiology reporting is reliable and most suited to formative assessments. (C) 2013 The Royal College of Radiologists. Published by Elsevier Ltd. All rights reserved.
引用
收藏
页码:1146 / 1154
页数:9
相关论文
共 21 条
[1]  
[Anonymous], BMJ CAREERS
[2]   Workplace-based assessment in radiology-where to now? [J].
Augustine, K. ;
McCoubrie, P. ;
Wilkinson, J. R. ;
McKnight, L. .
CLINICAL RADIOLOGY, 2010, 65 (04) :325-332
[3]   Malpractice issues in radiology - Pitfalls of the vague radiology report [J].
Berlin, L .
AMERICAN JOURNAL OF ROENTGENOLOGY, 2000, 174 (06) :1511-1518
[4]   Routine editing of trainee-generated radiology reports: Effect on style quality [J].
Coakley, FV ;
Heinze, SB ;
Shadbolt, CL ;
Schwartz, LH ;
Ginsberg, MS ;
Lefkowitz, RA ;
Hilton, S ;
Conlon, K ;
Leibel, S ;
Turnbull, A ;
Panicek, DM .
ACADEMIC RADIOLOGY, 2003, 10 (03) :289-294
[5]   Generalisability: a key to unlock professional assessment [J].
Crossley, J ;
Davies, H ;
Humphris, G ;
Jolly, B .
MEDICAL EDUCATION, 2002, 36 (10) :972-978
[6]   Sheffield Assessment Instrument for Letters (SAIL): performance assessment using outpatient letters [J].
Crossley, JGM ;
Howe, A ;
Newble, D ;
Jolly, B ;
Davies, HA .
MEDICAL EDUCATION, 2001, 35 (12) :1115-1124
[7]   Good questions, good answers: construct alignment improves the performance of workplace-based assessment scales [J].
Crossley, Jim ;
Johnson, Gavin ;
Booth, Joe ;
Wade, Winnie .
MEDICAL EDUCATION, 2011, 45 (06) :560-569
[8]   Vive la difference! A recall from knowing to exploring [J].
Crossley, Jim G. M. .
MEDICAL EDUCATION, 2010, 44 (10) :946-948
[9]  
Denison A., 2010, WORKPLACE BASED ASSE
[10]   Improving the quality of outpatient clinic letters using the Sheffield Assessment Instrument for Letters (SAIL) [J].
Fox, AT ;
Palmer, RD ;
Crossley, JGM ;
Sekaran, D ;
Trewavas, ES ;
Davies, HA .
MEDICAL EDUCATION, 2004, 38 (08) :852-858